Submit Your Article Forum Rules

Results 1 to 8 of 8

Thread: No cashed but still optimized?

  1. #1
    Junior Member
    Join Date
    Oct 2004
    Posts
    5

    No cashed but still optimized?

    We have a large client that we've been doing some web development work for. The other day I was asked to do some basic SEO for them. The problem is that they don't want their site to be cashed, and are at the current moment using robot.txt to disallow all bots.

    Is there a way to let the bots in, without being cashed by them to achieve some sort of placement ?

    I know there are tags like the below I can use, but I have not been able to find any info on how thy effect bots :
    <meta http-equiv="Pragma" content="no-cache">
    <meta http-equiv="Cache-Control" content="no-cache">
    <meta http-equiv="Expires" content="0">

    Any suggestions?

  2. #2
    Senior Member
    Join Date
    May 2004
    Posts
    250

    Re: No cashed but still optimized?

    Quote Originally Posted by psynaut
    <meta http-equiv="Pragma" content="no-cache">
    <meta http-equiv="Cache-Control" content="no-cache">
    <meta http-equiv="Expires" content="0">
    The code above stops the page being held in the browser's cache.

    If you want to stop the SE bots from caching your site then this should do:
    <META NAME="ROBOTS" CONTENT="NOARCHIVE">

  3. #3
    WebProWorld MVP
    Join Date
    May 2004
    Posts
    1,656
    braknews is right, you need to allow certain bots to index the site through the robots.txt file and then put the no archive tag on all the pages so they won't cache the pages.
    Follow me on Twitter, I'm bhartzer or like my page on Facebook.

  4. #4
    Junior Member
    Join Date
    Oct 2004
    Posts
    5
    Thanks for the help guys.

    Just one more question. Will the above also keep Alexa and The Internet Archive from archiving the site?

  5. #5
    Senior Member DrTandem1's Avatar
    Join Date
    Oct 2003
    Posts
    1,828
    The tags only work, if the robot is programmed to obey them.
    DrTandem's San Diego Web Page Design, drtandem.com

  6. #6
    Junior Member
    Join Date
    Dec 2004
    Posts
    1

    Interesting question but why not be cached?

    This is an interesting thing to do but why would you NOT want your web site cached? Since all of the search engines update on a schedule and not immediatly after there spider comes through your web site, what advantages would there be in not having a snap shot taken of the last visit. This would not make them update your site any faster in the rankings. I don't get the purpose of all the extra work, could someone exlain it to me?

  7. #7
    WebProWorld MVP
    Join Date
    Sep 2003
    Posts
    1,156

    Internet Archive

    Some people just don't like having their content kept anywhere they can't control it.

    The more common reason is that if you are cloaking your site it is easier to detect if one can view the cached version.

    Psynaut, you'll need to use your robots.txt to prevent the archive from keeping a cached copy of your site. Here is their instructions on how to do it.

  8. #8
    Junior Member
    Join Date
    Oct 2004
    Posts
    5
    Again, thanks for the help guys.

    GraphXtreme - Like flood6 said "Some people just don't like having their content kept anywhere they can't control it." ..... in this case, its product prices.

Similar Threads

  1. Is my site well optimized?
    By handcrafteduk in forum Search Engine Optimization Forum
    Replies: 3
    Last Post: 04-19-2007, 10:30 AM
  2. Is this URL optimized?
    By varun8211 in forum Search Engine Optimization Forum
    Replies: 4
    Last Post: 11-26-2006, 05:37 PM
  3. How to optimized
    By ariful in forum Search Engine Optimization Forum
    Replies: 1
    Last Post: 04-19-2006, 07:44 PM
  4. Optimized PDF files
    By Softland in forum Google Discussion Forum
    Replies: 2
    Last Post: 04-21-2005, 02:58 AM
  5. PR cashed page question
    By fillthy in forum Google Discussion Forum
    Replies: 1
    Last Post: 08-29-2004, 03:41 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •