Quote:
|
Originally Posted by Mel
Why do you think Googlebot (or other bots) are interested in your error logs?
These errors come about in the normal process of crawling a site where there are broken links. Bots will follow every link on a page, so if you do have mistakes on your page every time the page is spidered the errors will show up in your error logs. Alexa will find the same errors because it spiders in the same way.
|
I think perhaps I'm not explaining myself clearly :)
1. This page was only published incorrectly for
12 seconds before I corrected the error - 3 times. Does anyone think Google indexed it 3 separate times, catching all three versions of the error, in those 12 seconds?
It has nothing to do with any spider following any link on the page - the error was only on the page for 12 seconds - the page was not indexed - it was a single post on a thread - and I edited the post 3 times in 12 seconds to get it right. No way it was indexed by two different bots catching all three different versions of the error in 12 seconds :)
Is there another answer? I assure you, it has nothing to do with spidering. Here's another example - this should clarify what I'm trying to say:
This was the first instance - and this example proves that it has nothing to do with any spidering or indexing of pages. That day, I made a typo while entering a URL in my browser - except I didn't know it was a typo so when the page failed, I checked my error log. I was shocked to see not only my entry with the typo, but immediately below, another IP that has entered the same exact typo! The above image shows me intentionally
typing into my browser urls that do not exist and have never existed - it was a test. Google followed up by calling the same exact nonsensical urls
that I had typed. If that's not proof that it has nothing to do with spidering or indexing, then I dunno what it :)
Any ideas? Thanks, it's driving me nuts not knowing :)