Quote:
|
Originally Posted by plagarist_einstein
Hi,
My first post on this forum! I have always wanted to ask some questions. It will be great if someone can help me with this.
How do you know that spidering is going on? Is there any tool that tells you that your website is being spidered etc. How do you know which search engine crawled through your site?
Chandan
|
Chandan you have to look in your website's "control panel" area (like the cPanel login if that's what your hosts use) and look at the WebStats. There should also be an area for "RAW access logs" and you can download that and view it in Notepad, although it's a bit hard to read in it and VERY slow to open if the file is large. There are free readers on the new to view Raw access logs. If you're hosts don't use cPanel then you'll have to ask them how to get access to this area.
(If you happen to reply to this I'll never see the reply since I have yet to ever receive any of the email notifications).