Submit Your Article Forum Rules

Page 1 of 5 123 ... LastLast
Results 1 to 10 of 49

Thread: Block spiders from PART of a page?

  1. #1
    WebProWorld MVP davebarnes's Avatar
    Join Date
    Jul 2003
    Location
    Denver, CO USA
    Posts
    1,765

    Block spiders from PART of a page?

    Is it possible to block/prevent search engines from spidering PART of a page?

    I know how to seal off part/all of a website. My question here is: if I let a search engine spider get to a page can I separate the page into 2 parts: allowed for spidering and DISallowed?

    If yes, how do I accomplish that?

    thanks,
    dave
    Dave Barnes
    +1.303.744.9024
    WebEnhancement Services - Worldwide

  2. #2
    Moderator SteveGerencser's Avatar
    Join Date
    Jan 2005
    Location
    Small town Tennessee
    Posts
    2,174

    Re: Block spiders from PART of a page?

    You could put that part of the page in a javascript document.write command.. Supposedly SEs can't read javascript..

    Now, for the more interesting part, why would you want to do this??
    You can't create artful marketing with color by number seo

  3. #3

    Re: Block spiders from PART of a page?

    The only reason I can see for him wantiing to do this, is to have the pagerank for a links page, then not give away any link juice to potential link partners.

    Very sneeky!!
    Find your next holiday rental, and swimwear to go.

  4. #4
    Junior Member
    Join Date
    Aug 2008
    Posts
    2

    Re: Block spiders from PART of a page?

    using rel=no follow attribute or robot txt

  5. #5
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    8,925

    Re: Block spiders from PART of a page?

    Quote Originally Posted by sorahayda View Post
    using rel=no follow attribute or robot txt
    I hope this was a joke buddy. I think you should re-read the question.
    John S. Britsios, Forensic SEO & Social Semantic Web Consultant | SEO Workers | Webnauts Net

  6. #6
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    8,925

    Re: Block spiders from PART of a page?

    Quote Originally Posted by davebarnes View Post
    Is it possible to block/prevent search engines from spidering PART of a page?

    I know how to seal off part/all of a website. My question here is: if I let a search engine spider get to a page can I separate the page into 2 parts: allowed for spidering and DISallowed?

    If yes, how do I accomplish that?

    thanks,
    dave
    Dave we created a php script a while ago, where we could hide efficiently parts of our pages content. We took it down since Google announced that they perceive such as clocking and that they can spot such stuff with diffing using MD5 checksum.
    I still don't believe that they really can, but we want to be on the safe side just in case.

    About using Javascript I would also be careful. It is not 100% accurate information, that Google cannot read JavaScript at all.

    Would you mind being more specific what exactly your problem is, so I can see if we can come up with a possible legitimate solution?
    John S. Britsios, Forensic SEO & Social Semantic Web Consultant | SEO Workers | Webnauts Net

  7. #7
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    8,925

    Re: Block spiders from PART of a page?

    Quote Originally Posted by sunbedkid View Post
    The only reason I can see for him wantiing to do this, is to have the pagerank for a links page, then not give away any link juice to potential link partners.

    Very sneeky!!
    I do not believe Dave would do such stuff buddy. Don't you think you are getting sort of offensive here?
    Dave is a senior and highly respected member and professional here at WPW. So please think before you post.

    Thanks,

    John
    John S. Britsios, Forensic SEO & Social Semantic Web Consultant | SEO Workers | Webnauts Net

  8. #8
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    7,684

    Re: Block spiders from PART of a page?

    Is it possible to use AJAX technology, the XMLHttpRequest object and / or iFrames?

  9. #9
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    8,925

    Re: Block spiders from PART of a page?

    Quote Originally Posted by kgun View Post
    Is it possible to use AJAX technology, the XMLHttpRequest object or iFrames?
    For both options if accessibility is not a concern, then should not be a problem. Just in case we stick to the iframes, notice that they are not supported in XHTML Strict. Otherwise will be ok.
    John S. Britsios, Forensic SEO & Social Semantic Web Consultant | SEO Workers | Webnauts Net

  10. #10
    WebProWorld MVP crankydave's Avatar
    Join Date
    Aug 2004
    Posts
    4,726

    Re: Block spiders from PART of a page?

    That was my initial thought too... iFrames.

    Depending upon what it is, what about making it an image? If it was a chart or a block of text, put it in an image.

    Dave

Similar Threads

  1. will putting this link on my page hurt spiders?
    By srlabs in forum Marketing Strategies Discussion Forum
    Replies: 2
    Last Post: 12-29-2005, 01:41 PM
  2. How to Block a page from visitor viewing after they logout?
    By rsadik in forum Web Programming Discussion Forum
    Replies: 1
    Last Post: 05-19-2005, 05:38 PM
  3. Spiders on the Home Page!
    By MarcieZoob in forum WebProWorld: Guidelines/Announcements/Suggestions
    Replies: 6
    Last Post: 10-31-2004, 12:21 PM
  4. Question about spiders -- Why block??
    By jawn_tech in forum Search Engine Optimization Forum
    Replies: 12
    Last Post: 09-21-2004, 02:31 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •