Submit Your Article Forum Rules

Results 1 to 5 of 5

Thread: How much of a URL does the robot see ?

  1. #1
    Junior Member
    Join Date
    Aug 2004
    Posts
    4

    How much of a URL does the robot see ?

    We use a system of split testing on our site that involves including A or B as part of the URL as outlined below.
    www.sitename.com/A/index.htm and www.sitename.com/B/index.htm

    We send a percedntage of our traffic to each split but we have a no index tag on the A and the B splits to avoid having duplicate contrent being indexed.

    The robots just see www.sitename.com/index.htm

    Am I right in thinking that we could use something like
    www.sitename.com/index.htm#SPLIT_A

    Specific question - Is it correct that the google robot will ignore anything after the # in a url. If so we can use the www.sitename.com/index.htm#streama instead of www.sitename.com/A/index.htm

    Thanks

  2. #2
    WebProWorld MVP crankydave's Avatar
    Join Date
    Aug 2004
    Posts
    4,732

    Re: How much of a URL does the robot see ?

    That is correct. Anything after the # (hash) is ignored so Google will only see 1 URL.

    Dave

  3. #3
    WebProWorld MVP wige's Avatar
    Join Date
    Jun 2006
    Posts
    3,138

    Re: How much of a URL does the robot see ?

    But, a hash is an onpage link. Are you intending to use the hash in a script or rewrite, or for something else?
    The best way to learn anything, is to question everything.
    WigeDev - Freelance web and software development

  4. #4
    Junior Member
    Join Date
    Aug 2004
    Posts
    4

    Re: How much of a URL does the robot see ?

    We intend to use #splitA or #splitB to distinguish which split the visitor has been assigned to for a/b split testing purposes

  5. #5
    WebProWorld MVP wige's Avatar
    Join Date
    Jun 2006
    Posts
    3,138

    Re: How much of a URL does the robot see ?

    Please be aware that most browsers (I only tested this in Firefox, but I think it also applies to Internet Explorer) do not transmit anything after the #. The #splitA or #splitB portion would not show up in any logs or be accessible to your server side scripts.
    The best way to learn anything, is to question everything.
    WigeDev - Freelance web and software development

Similar Threads

  1. Unknown robot (identified by 'robot')
    By chandrika in forum Webmaster Resources Discussion Forum
    Replies: 7
    Last Post: 03-31-2011, 10:37 AM
  2. Robot txt.
    By misterc in forum Google Discussion Forum
    Replies: 1
    Last Post: 06-24-2005, 05:26 AM
  3. robot.txt ????
    By vanman465 in forum Search Engine Optimization Forum
    Replies: 1
    Last Post: 07-29-2004, 10:55 PM
  4. do i have to have a robot.txt?
    By saghir69 in forum Google Discussion Forum
    Replies: 9
    Last Post: 06-04-2004, 01:01 PM
  5. What is Robot.txt
    By ellar in forum Search Engine Optimization Forum
    Replies: 2
    Last Post: 05-04-2004, 02:22 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •