Quote:
Originally Posted by activeco
OK, to continue from here:
Yes, it will. What bots get is not exactly the same page as a regular browser gets and that is a typical cloaking.
Unlike when using (i)frame where the html+content of that page remains exactly the same. For now, content of the linked page is not important in this case. |
The content of the linked page is important. That is what I would hide with an IFRAME, disallowing bots to follow the target though a noindex meta tag or robots.txt.
Quote:
Originally Posted by activeco
P.S. Currently your setup returns 403 for active.html, which was probably not what you wanted.
|
What is the difference if I would disallow the bots accessing a page with robots.txt or with a 403?