Spiders

[The_Friendly_Fiend]

Danny, I'm not sure if you visit the vbulletin forum, but there's a helpful hint that may squish all the goggle spiders that I see when I check the "who's online" link. It could save you some bandwidth and looks fairly easy to install.

http://www.vbulletin.com/forum/showthread.php?t=45828

[LeeCHeSSS]

Ofcourse I visit that forum, and I have tried such a robots.txt file. But it makes Inktomi choke entirely; and since Yahoo seems to be the search engine that ranks the site highest (5th), I'm not going to cut my own fingers by stopping new visitors coming here through Yahoo.