No cashed but still optimized?

[psynaut]

We have a large client that we've been doing some web development work for. The other day I was asked to do some basic SEO for them. The problem is that they don't want their site to be cashed, and are at the current moment using robot.txt to disallow all bots.

Is there a way to let the bots in, without being cashed by them to achieve some sort of placement ?

I know there are tags like the below I can use, but I have not been able to find any info on how thy effect bots :
<meta http-equiv="Pragma" content="no-cache">
<meta http-equiv="Cache-Control" content="no-cache">
<meta http-equiv="Expires" content="0">

Any suggestions?

[braknews]

<meta http-equiv="Pragma" content="no-cache">
<meta http-equiv="Cache-Control" content="no-cache">
<meta http-equiv="Expires" content="0">
The code above stops the page being held in the browser's cache.

If you want to stop the SE bots from caching your site then this should do:
<META NAME="ROBOTS" CONTENT="NOARCHIVE">

[bhartzer]

braknews is right, you need to allow certain bots to index the site through the robots.txt file and then put the no archive tag on all the pages so they won't cache the pages.

[psynaut]

Thanks for the help guys.

Just one more question. Will the above also keep Alexa and The Internet Archive from archiving the site?

[DrTandem1]

The tags only work, if the robot is programmed to obey them.

[GraphXtreme]

This is an interesting thing to do but why would you NOT want your web site cached? Since all of the search engines update on a schedule and not immediatly after there spider comes through your web site, what advantages would there be in not having a snap shot taken of the last visit. This would not make them update your site any faster in the rankings. I don't get the purpose of all the extra work, could someone exlain it to me?

[flood6]

Some people just don't like having their content kept anywhere they can't control it.

The more common reason is that if you are cloaking your site it is easier to detect if one can view the cached version.

Psynaut, you'll need to use your robots.txt to prevent the archive from keeping a cached copy of your site. Here (http://www.archive.org/about/faqs.php#2) is their instructions on how to do it.

[psynaut]

Again, thanks for the help guys.

GraphXtreme - Like flood6 said "Some people just don't like having their content kept anywhere they can't control it." ..... in this case, its product prices.