GOOGLE Limits Dynamically Generated Page Listings!

[greeneagle]

GOOGLE Limits Dynamic Page Listings!

Is this new? I haven’t seen it before:

Reasons your site may not be included.

"Your pages are dynamically generated. We are able to index dynamically generated pages. However, because our web crawler can easily overwhelm and crash sites serving dynamic content, we limit the amount of dynamic pages we index."

Evidently this is a number 1 cause now, or it wouldn't be listed first.

Is it a mega-Site garbage issue or what?

Ken

[ctabuk]

Ken Hi, that link is down. Cheers David

[jestep]

As far as I know it has been up for a long time. I dont think it means much.

More of a catch all disclaimer so webmasters can't complain too much when their 2.5 million page, auto generated site isn't fully indexed.

Here's the link again:
http://www.google.com/webmasters/2.html

[greeneagle]

Thanks David, I think I got it right this time.
Ken

[greeneagle]

I paruse through GOOGLE webmaster pages pretty often and I had not noticed that one before. Did they initiate that alg feature to defer garbage to the dump?

There are "legits" though such as "mapping" sites, but they further admonish them here:
http://www.google.com/webmasters/guidelines.html

"If you decide to use dynamic pages (i.e., the URL contains a '?' character), be aware that not every search engine spider crawls dynamic pages as well as static pages. It helps to keep the parameters short and the number of them small."

I have ran into several issues involving non-W3C validateable characters in dynamically generated URLs from different sources including Mapquest.

Ken

[labeler2003]

I remembered that statement as being there for a long time. But since I never trust my memory, I did a quick search and found forum entries that quoted it dating as far back as 10-02-2002.

[greeneagle]

Guess I just missed it since I had never been concerned with dynamically generated pages.

There are a lot of associated enquiries in the forums here.. wanting to know why they aren't listed and so on. You would think this would have been pulled out in response before now.

I just haven't seen it before.

Ken

[cspelts]

I've found that statement to be very true! Google has indexed most of my dynamically generated pages, but not all.

I'm hoping that in the future they figure out a way to come back and index an entire site, if in the past that site has proven to have original content. The web does not need more "mega-Site garbage" pages indexed, but if a site has all original, unique and valuable content, it would be nice to see it indexed.

[DMC_34]

It has been there for sometime. I remember seeing it last year. G still indexs most of our dynamic pages. Slower the site the less indexing it will do.