Thread: How do you know when you've been crawled?
View Single Post
  #3 (permalink)  
Old 08-06-2004, 01:12 PM
buddhu buddhu is offline
WebProWorld Pro
  
Join Date: Mar 2004
Location: UK
Posts: 203
buddhu RepRank 0
Default
Hi Diva,

It might be helpful to get a list of the IP addresses used by various crawlers.

Check out http://www.searchengineworld.com/spiders/spider_ips.htm
Reply With Quote