iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Google Discussion Forum Google Discussion forum is for topics specifically related to Google. There is a subforum dedicated to AdSense/AdWords subjects.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 06-08-2006, 07:40 PM
WebProWorld Member
 
Join Date: Oct 2005
Posts: 26
emptymirror RepRank 0
Default Page not indexed but has PR?

I just discovered something odd (at least I think it's odd).

My robots.txt file disallows a page, bio.html

(Actually, most of the pages on my site are disallowed - it's mostly a portfolio site. But that's beside the point.)

A Google site: search finds 5 pages from my website indexed, but not bio.html

Yet, bio.html has a PR2

Bio.html has been off-limits to the search engines for a long time now. Why would it have a PR? Does that mean that Google is still crawling the page?

If anyone can enlighten me, I'd be most grateful!

Thanks!
Denise
Reply With Quote
  #2 (permalink)  
Old 06-09-2006, 09:57 AM
crankydave's Avatar
Moderator
WebProWorld Moderator
 
Join Date: Aug 2004
Location: Playing with fire!
Posts: 4,243
crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9crankydave RepRank 9
Default Re: Page not indexed but has PR?

Quote:
Originally Posted by emptymirror
I just discovered something odd (at least I think it's odd).

My robots.txt file disallows a page, bio.html

(Actually, most of the pages on my site are disallowed - it's mostly a portfolio site. But that's beside the point.)

A Google site: search finds 5 pages from my website indexed, but not bio.html

Yet, bio.html has a PR2

Bio.html has been off-limits to the search engines for a long time now. Why would it have a PR? Does that mean that Google is still crawling the page?

If anyone can enlighten me, I'd be most grateful!

Thanks!
Denise
PR is stored in a different database than the page information. If there any links pointing to the bio.html that Google is aware of, either external or from the pages of your site that are indexed, PR will be assigned to the target URL regardless of whether or not the page information gets crawled.

Dave
Reply With Quote
  #3 (permalink)  
Old 06-09-2006, 01:16 PM
WebProWorld Member
 
Join Date: Oct 2005
Posts: 26
emptymirror RepRank 0
Default

Oh, I see. Thanks! I thought keeping Google away from a page would result in its basically ignoring that page's existence. But I guess it's not the case.

That eases my mind - I really don't want that page findable on Google & was worried it was indexed somewhere that I couldn't see.

Thanks again.

cheers ~
Denise
Reply With Quote
Reply

  WebProWorld > Search Engines > Google Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 05:26 PM.



Search Engine Optimization by vBSEO 3.3.0