Submit Your Article Forum Rules

Results 1 to 4 of 4

Thread: Hold crawler?

  1. #1
    Junior Member
    Join Date
    Sep 2005
    Posts
    24

    Hold crawler?

    Dear All,

    I have 2 queries plz help me by replying:

    (1) Can anyone tell me how to hold the crawler in your webpage?

    (2) Can I target any URL for ranking which has # in it? For eg. http://www.abc.com/abc.htm#

    Thanks in advance!!
    Mac

  2. #2
    Senior Member
    Join Date
    Dec 2003
    Posts
    133

    Hold the crawler?

    Mac, I'm not sure what you mean by "hold the crawler." Let's define what a crawler is: it's a piece of software that is designed to visit your entire web site and pickup keywords and keyword phrases that give it an idea of what your site is about. It grabs these phrases from the Title tags, meta tags (some do some don't do meta tags) and, most importantly, body copy. The crawler will "read" all of the text on your home page and follow the links (if it can) to index your entire site.

    There is no way to "hold" it on your site. There is a way to keep it from indexing your site or pages of your site: robot.txt. This is used for pages that you DON'T want crawled.

    Now about "targeting" a URL: do you mean to link to a URL? Of course you can link to any URL you want - for ranking purposes, however, the entire page will rank, not a particular part of a page (usually signified by the # link). So a particular keyword phrase may or may not bring this page up for a query depending on the actual page content.

  3. #3
    Junior Member
    Join Date
    Sep 2005
    Posts
    24

    Crawler revisit

    Thanks Mawells for the reply.

    I want guidance for the following also:

    Wat all meta tags are available other than title, desc & keywords which I can use for ranking purpose.

    In the meta tag we put "content revisit= 2days", does it work in practical?

    Plz help by replying

    Mac

  4. #4
    WebProWorld MVP incrediblehelp's Avatar
    Join Date
    Jan 2004
    Posts
    7,567

    Re: Crawler revisit

    Quote Originally Posted by bijunair
    Wat all meta tags are available other than title, desc & keywords which I can use for ranking purpose.
    No others.

    Quote Originally Posted by bijunair
    In the meta tag we put "content revisit= 2days", does it work in practical?
    No.

Similar Threads

  1. Don't hold back please!
    By astro in forum Submit Your Site For Review
    Replies: 20
    Last Post: 01-21-2009, 11:47 PM
  2. Google crawler & webmaster crawler
    By sally in forum Search Engine Optimization Forum
    Replies: 4
    Last Post: 03-08-2008, 11:09 AM
  3. SMA-NA To Hold Elections
    By WPW_Feedbot in forum Search Engine Optimization Forum
    Replies: 0
    Last Post: 09-15-2005, 08:00 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •