In a mildly weird fashion, Google answered some questions regarding HTTP status codes and "if-modified-since" from users who were either made up or had their names changed to protect their anonymity. Names like Little Jimmy, Temp O’Rary, Janet Crinklenose, and Frankie O’Fore (my apologies to any Janet Crinklenoses who may be out there, but I think I’m safe in my assumption that the name is fictitious).
Googlebot Gets Candid
Googlebot is like a dream which knows us all , , and soul. Here in this interview, Maile Ohye as the website and Jeremy Lilley as the Googlebot from Google Central Webmaster blog would answer all those questions that you ever had. Question & Answers Googlebot: ACK
GoogleBot Crawls CSS Files
Barry Schwartz spotted a thread in the Cre8site Forums discussing a report by Ekstreme.com that Googlebot requested a CSS file. This is a very interesting, but not surprising development.
Googlebot Wields New Crawl Tools
Bringing your website into the voluminous BigTable of Google’s index involves sending out pieces of code, referred to as spiders or crawlers affectionately named “Googlebot,” to pick up your site. Google Webmaster Central has some tips for webmasters showing how they can learn more about Googlebot.
When Was the Last Time You Saw the Googlebot?
The Google crew cleared up a bit about how the Googlebot caches webpages. The date at the cached page reflects the last time the page was modified.
Quoth The Googlebot, “304!”
The latest news from Google Webmaster Central disclosed how the search engine’s spider saves a webmaster from unnecessary bandwidth costs.
Matt Cutts Reins In Googlebot
Ahead of Search Engine Strategies 2006 conference in San Jose, Google’s best-known engineer suggested some basic approaches to making a visiting Googlebot behave when it drops by your website.
GoogleBot the “Spider of Doom”
A funny story is circulating in tech circles about how Googlebot inadvertently destroyed the database of a content management system (CMS) based site that took months of work to build.
Playing in Googlebot’s Sandbox with Slurp, Teoma & MSNbot Spiders Display Distinctly Differing Personalities
There has been endless webmaster speculation and worry about the so-called “Google Sandbox” – the indexing time delay for new domain names – rumored to last for at least 45 days from the date of first “discovery” by Googlebot. This recognized listing delay came to be called the “Google Sandbox effect.”
The Googlebot Assault Continues
Now that the long-awaited PR update has come and gone, there are reports of the Google’s indexing spider continuing to perform comprehensive site scans. Recently, Murdok ran an article discussing these types of scans and the majority of the speculation pointed towards the upcoming PR update. Now that this quarter’s update is complete, why is the Googlebot continuing to bombard sites?