Ah, if you liked that story ... try this one at WPW
http://www.webproworld.com/viewtopic.php?p=65170#65170. That is my Googlebot
PR River story. Mel liked that one a lot as I remember. ;0)
I am not sure, but the Almaden has a unique purpose for some reason that I cannot remember right off hand. I just read something about it the other day too.
I don't blame you about cutting any of the others off. Especially the types that look more like they are data mining (as opposed to the spybot type). That was the case with the Fast Enterprise bot ... after it went thru the site once and proceeded to do it again, that is where I drew the line.
Bandwidth is not an issue though...well not on the site mentioned above. If it were, that darn thing would have pushed your normal bandwidth allotments to the edge.