Google not indexing URL's from xml sitemap

[Nigel@xposure]

Hi,

I have an xml sitemap for my site and it has been registered with google webmaster tools for about a month now. The sitemap has 1,240 URL's, but google has only indexed 140.

The sitemap is dynamically built, so when I edit or add a new page to the site, the sitemap is automatically rebuilt and given a rating relevant to it's position in the site.

Does anyone know or have any ideas on why google has indexed such a low number?

The crawl errors show only 1 unreachable address, but this is not in the sitemap.

Any help or advice on where to look or what to check would be appreciated.

Thanks

[wige]

Google places it's priority on links. Having links to pages on your site is the best way to ensure they are crawled. However, the amount of time Google is willing to spend on your site is also based on your inbound links. To have your content crawled faster, I would recommend working on building your relevant inbound links.

[innominds]

Submitting a sitemap doesn't guarantee you to index all the web pages of your site.
You need to build links for your site.

[Nigel@xposure]

Thanks for the responses so far.

Do I need to build links to the unindexed pages or just to the home page? Or doesn't it matter?

[Doc]

Thanks for the responses so far.

Do I need to build links to the unindexed pages or just to the home page? Or doesn't it matter?

It does matter, Nigel. However, it's what some would consider "fine-tuning". There is a thread here that offered a link (Webnauts posted it, I believe?) that talks about how to structure internal links to distribute the IBL juice where it's best applied. I'll have to look for it. Or perhaps someone else will have the link.

[bugzy]

are you seeing any error on webmaster tool?

[shakir]

Hi,

I have an xml sitemap for my site and it has been registered with google webmaster tools for about a month now. The sitemap has 1,240 URL's, but google has only indexed 140.

The sitemap is dynamically built, so when I edit or add a new page to the site, the sitemap is automatically rebuilt and given a rating relevant to it's position in the site.

Does anyone know or have any ideas on why google has indexed such a low number?

The crawl errors show only 1 unreachable address, but this is not in the sitemap.

Any help or advice on where to look or what to check would be appreciated.

Thanks

Well, if the site map count all the page and no report any error then no need to worry. TO finish index all the pages will take long time.. My site took 9 months to finish indexing all the pages. So keep updating sitemap and make resubmit each time... Also wait some more time

[EAG]

your site need some PR to index all these urls, so build more high PR links

[ncseo]

if you want your homepage indexed then get backlinks to your homepage

if your homepage has great internal linking then your other pages may get indexed as well

if that doesnt work then get backlinks directly to the page you want indexed

[angilina]

Thanks for the responses so far.

Do I need to build links to the unindexed pages or just to the home page? Or doesn't it matter?

If you want a page or pages to get indexed, then I guess you will have to build backlinks pointing to these un-indexed pages. And if you want these pages to index and rank better in SERP then that will depend on the quality and quantity of backlinks that are pointing to these pages. And I think you should get backlinks for the homepage too: that will help the whole site.

[chowell]

If you work on building up your overall backlink profile, you will see your # of indexed pages improve. You can do this via several methods:

- Link to important hub pages from your homepage.
- Get more links to your homepage (both in quantity & uniqueness).
- Get some deeper links to your hub pages (or deeper).

The sitemap file is nothing more than a guide for Google - there is no guarantee they will index the pages in the list.

As a side note... Are you sure your 1,000+ pages are quality enough to justify individual indexing? This isn't to question your legitimacy as a site owner, etc. but rather to point out that the SE's only want unique content. If you are just promoting a datafeed or other "duplicate content" products, you're not going to be able to increase your # of indexed pages easily. Google doesn't want them in that case.

[ogletreeseo]

Try submitting an xml feed for your site to feedburner.

[jandrewee]

links are still most important, focus on that and pinging, this always helps me out

[nichita2008]

All these pages are unique? You have duplicate content in this sitemap? You have setup "noindex" to categories / archive / pages in wordpress (if you have a wordpress site) ?