iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Go Back   WebProWorld > Search Engines > Search Engine Optimization Forum
Questions about robot.txt
Index Link To US Private Messages Archive FAQ RSS
Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 07-08-2006, 01:26 AM
WebProWorld New Member
  
Join Date: Jun 2006
Location: St. Louis
Posts: 16
csutoras RepRank 0
Default Questions about robot.txt
If you don't have anything private, what is the purpose of having a robot.txt...

Any added value for having one?

Thanks
Reply With Quote
  #2 (permalink)  
Old 07-08-2006, 01:42 AM
stymiee's Avatar
WebProWorld Veteran
  
Join Date: May 2006
Location: New Jersey
Posts: 429
stymiee RepRank 0
Default
They are used to tell web crawlers what files they cannot crawl. Having one does not boost your rankings in the SERPs.
__________________
John Conde
Brainyminds Merchant Account Services eBook Giant
Reply With Quote
  #3 (permalink)  
Old 07-08-2006, 03:23 PM
incrediblehelp's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
  
Join Date: Jan 2004
Location: Live in Cincy Now
Posts: 7,573
incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4
Default
Having one also avoids the search engines getting a 404 error everytime they look for one.
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

« Best Option: Landing Pages or Sub Domain Pages??? | To optimise or optimize, that is the question »
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -4. The time now is 08:51 AM.

WebProWorld - Archive - Top

WebProWorld | Advertise | Contact Us | About | Forum Rules | MVP's | Archive | Newsletter Archive | Top | WebProNews
WebProWorld is an iEntry, Inc. ® site - © 2009 All Rights Reserved Privacy Policy and Legal
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509

Search Engine Optimization by vBSEO 3.3.0