do search engines follow robots rules?

grown · #1 (**permalink**) 01-14-2009, 02:02 PM

I have set my robots to NO FOLLOW and I have submited my sitemaps bue google still indexes pages with my ? Query strings and I am recieving duplicate entries How do I fix this

Thanking you in advance,

Jeremy

MrGamm · #2 (**permalink**) 01-14-2009, 03:33 PM

Maybe you could try running your robots.txt file through a validator... Typically the allow statement is redundant.

I've never used this one before but maybe it will help...

Validators | Robots.txt Validator

Just because you add a robots does not mean google will immediately drop those pages. It could take a bit if it's anew addition.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Do search engines follow area maps?	wwwizzard	Other Engines/Directories	4	09-29-2006 06:19 PM
Robots, Indexing, Follow	Andy Romano	Search Engine Optimization Forum	1	10-22-2005 02:55 PM
64% Of Search Advertisers Fail To Follow SEO Recommendations	Chris	Marketing Strategies Discussion Forum	18	10-08-2005 07:05 AM
(Updated) Follow On No Follow: Will "Fully web-expressed wr	WPW_Feedbot	Search Engine Optimization Forum	0	01-20-2005 12:30 AM
Can search engines follow this link?	sandym	Search Engine Optimization Forum	5	08-19-2004 10:41 AM