Submit Your Article Forum Rules

Results 1 to 2 of 2

Thread: robot.txt file

  1. #1

    robot.txt file

    Is it possible that I could have over 36,000 hits to my robot.txt file last month?

    It seems awful high considering I am only getting over 6,000 visitors for last month. I know there are not directly related, but if the file is being hit that much, don't you think the search engines would have up-to-date links from my site?

    Maybe I don't know what I am talking about, anyone want to chime in?

  2. #2
    Senior Member stymiee's Avatar
    Join Date
    May 2006
    Posts
    427
    It's possible if your site is crawled frequently although I have to agree that figure is on the high side.

Similar Threads

  1. Unknown robot (identified by 'robot')
    By chandrika in forum Webmaster Resources Discussion Forum
    Replies: 7
    Last Post: 03-31-2011, 10:37 AM
  2. Robot.txt file -What Should You Block?
    By kateperry in forum Search Engine Optimization Forum
    Replies: 5
    Last Post: 08-19-2009, 06:50 AM
  3. robot.txt file
    By midiman52 in forum Search Engine Optimization Forum
    Replies: 4
    Last Post: 06-13-2007, 11:00 PM
  4. Windows 2000 Slow with File Open and File Save Dialog Boxes
    By steve0 in forum IT Discussion Forum
    Replies: 2
    Last Post: 09-15-2005, 05:27 PM
  5. Robot TXT file
    By Chezeater in forum Search Engine Optimization Forum
    Replies: 3
    Last Post: 07-11-2004, 10:38 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •