iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 08-16-2007, 01:03 AM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,167
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default Robots meta tags or Robots.txt?

Google introduced a new META tag that allows you to tell them when a page should be removed from the main Google web search results called unavailable_after tag.


This one follows a similar syntax to other META tags. For example, to specify that an HTML page should be removed from the search results after 8pm Eastern Standard Time on 19th August 2007, simply add the following tag to the first section of your page:

<META NAME="GOOGLEBOT" CONTENT="unavailable_after: 19-Aug-2007 08:00:00 EST">

But how could you tell the robots that the site is unavailable between certain hours of the day?


An Extended Standard for Robot Exclusion has been proposed, which adds several new directives, such as Visit-time. For example:

User-agent: *
Disallow: /downloads/
Visit-time: 0600-0845 # only visit between 6:00 AM and 8:45 AM UT (GMT)

What do you think about that?

Do you think this would work too?

User-agent: *
Disallow: /downloads/
Visit-time: 19-Aug-2007 0600-0845 # only visit on the 19th of August 2007 between 6:00 AM and 8:45 AM UT (GMT)

You contribution would be very appreciated.
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO

Last edited by Webnauts; 08-16-2007 at 01:05 AM.
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Robots.txt help amar Search Engine Optimization Forum 1 02-09-2006 10:54 AM
Robots.txt 27thNub Search Engine Optimization Forum 3 09-27-2004 05:40 PM
Robots.txt... WHY Clicken Search Engine Optimization Forum 1 08-19-2004 05:33 PM
Meta Tags / Alt Tags/robots is confusing CaronWorldWide Search Engine Optimization Forum 2 08-11-2004 02:20 PM
Robots.txt candlese Graphics & Design Discussion Forum 5 03-09-2004 07:54 PM


All times are GMT -4. The time now is 11:39 PM.



Search Engine Optimization by vBSEO 3.3.0