Quote:
Originally Posted by activeco
You still don't get it, do you?
'X-robots-tag' IS THE SAME as the '<META name='robots'..>' tag. How many people use it?
|
I know that. And I use that. How many other people do that, I have no idea.
Quote:
Originally Posted by activeco
Why was it introduced? Well for a good reason. You can use META tags only in html documents.
Putting this right in the header enables other application types to deal with robots, but for a html document it doesn't make any difference.
|
Do you mean that adding the X-Robots in the .htaccess file instead does not work for HTML files? I hope not!
Can you tell us why doesn't this page get indexed by Google?
Google & Yahoo Crawlability
I will show you why:
View HTTP Request and Response Header
Quote:
Originally Posted by activeco
The end of story for this thread was actually definitive answer Jaan provided:
Let me emphasize that PR sculpting DOES work.
The question about actual benefits of it deserves a new thread. |
I never doubted that
PR sculpting works. As a Web Architect I just consider the way it is presented all over the place as insufficient.