How can I tell if & when bots crawl my site?

[ATK]

Hi guys n girls,

Could someone please put me out of my misery and tell me how I can find out if and when bots/spiders from Google etc. crawl my site? I'm probably just being very ignorant but I really would like to know how I could access these kinds of stats.


Thanks in advance!

[kgun]

http://www.iplists.com/

http://www.jafsoft.com/searchengines/webbots.html

http://www.google.com/Top/Computers/...ngines/Robots/

http://www.google.com/webmasters/bot.html

http://forums.seochat.com/archive/t-...gle-Deep-Crawl

http://forums.digitalpoint.com/showthread.php?t=1122


Search term:
Search Engine spider OR bot identification

Combine that list with Cpanel http://www.cpanel.com/ or whatever tool you have.

[ATK]

Thanks for your help kgun...I'll attempt to get my head round this asap!!!

[kgun]

More specific search at Google.com

site:www.webmasterworld.com search engine spider identification

[khurramali]

Ask your hosting company to install AWSTATS on their server, will take away your headaches.

[ATK]

Hi khurramali,

I'm already using statcounter; will awstats work alongisde it or would it be best if I replace it with awstats?

Many thanks!