iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Google Discussion Forum Google Discussion forum is for topics specifically related to Google. There is a subforum dedicated to AdSense/AdWords subjects.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 09-03-2004, 12:31 PM
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: May 2004
Location: Austin, TX
Posts: 1,229
jestep RepRank 0
Default Google Ignores Robots.txt

On every one of my sites, google has been ignoring my robots.txt files. They still obey any meta robots tags, but not the robots.txt files. Maybe I am writing them wrong, but take a look.

Code:
User-Agent: *
Disallow: /incred/
There are several pages in this directory that are indexed. It has been blocked even before the directory was created, so theres no way that google found the pages before the robots.txt.
Reply With Quote
  #2 (permalink)  
Old 09-03-2004, 01:39 PM
WebProWorld Pro
 
Join Date: Mar 2004
Location: USA
Posts: 228
ReviewGolf.com RepRank 0
Default

Looks correct. I'd suggest contacting Google directly with your concerns. If the statement is true this could be pretty bad for Google's publicity. My guess they'll get back to you on this right away.
__________________
Site for sale: http://reviewgolf.com

"Web design is the area saturated by amateurs that confuse software capabilities with their own talent." ~~ me
Reply With Quote
Reply

  WebProWorld > Search Engines > Google Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 04:13 AM.



Search Engine Optimization by vBSEO 3.3.0