We usually get between 100 and 300 hits a night from Google and MSN spiders and 1 or 2 from unknown robots. Last night we got 74000 hits from an unknown robot identified by crawl. They downloaded 1.02 GB of data - MSN downloaded 7 MB. Any idea what this is from?

Thanks,
Tom[/quote]