Google downloads sitemap.xml and robots.txt but...

#1 (permalink)

11-05-2008, 11:24 AM

salvatooo

WebProWorld New Member

Join Date: Nov 2008

Posts: 1

Google downloads sitemap.xml and robots.txt but...

i notice googlebot download sitemap.xml and robots.txt daily...

but it did not crawl into any other files that are listen in sitemap.xml

is that normal? any workaround?

« Home page (Domain) disappeared from Google Index | Barack Obama T Shirts - on or off page best »

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Trackbacks are On Pingbacks are On Refbacks are On Forum Rules

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Errors of robots.txt unreachable in google webmaster sitemap	pervezalam_mzn	Google Discussion Forum	2	08-30-2008 01:51 AM
Sitemap used as a replacement for robots.txt	cppgenius	Google Discussion Forum	8	09-07-2007 10:52 AM
Robots meta tags or Robots.txt?	Webnauts	Search Engine Optimization Forum	0	08-16-2007 01:03 AM
Book downloads coming to Google	dutter	Google Discussion Forum	2	08-31-2006 12:18 PM
Downloads of Google Earth Temporarily Halted	WPW_Feedbot	Search Engine Optimization Forum	0	06-29-2005 08:00 PM

All times are GMT -4. The time now is 02:59 AM.