Complete crawl using only main pages in a sitemap?

[raj7]

Hi,

I'm considering having a google sitemap, but not including all the pages in the google sitemap (simply because pages are added at quite a frequent rate).

If I add the main pages to the google sitemap, is that enough? Will the spiders crawl from those main pages to to pages off the site map to give a full crawl (if there are links from the main pages)?

Thank you in advance,

Kind regards

Raj

[holyhttp]

The sitemap by itself makes it easy for the SE to find in one location all the pages you want them to crawl. However the main pages to the google sitemap with links from those main pages to subpages, the Search Engines will find their way.

My main web site does not have a google sitemap yet all my web pages are now indexed. A good internal linking structure is the key.

[Webnauts]

A good internal linking structure is the key.

Exactly!!!

[jomariet]

There are 2 points to adding a Google Sitemap. The first is to tell Google where to find the pages of your site. If your site is structured well, you don't really need to do that. Google will find your pages on their own.

The real reason for a well structured website to have a Google Sitemap is for the data you get back from them. The feedback Google will give you is above and beyond the site statistics and analytics information. So often webmasters approach SEO as a guessing game. "If I tweak this, will I get this result?". Google's webmaster tools (results of the sitemap) will take a lot of the guess work out of the process.

It's not perfect. For example - the web crawl results will show you errors that Google's spiders found but not what page they found them on. If your site is large it can be very frustrating trying to find an old link to an old page.

On the other hand, you can see within a few clicks many of the factors that help and hurt your SERP which give you the tools to fix these issues.

The fastest, easiest way to get a google sitemap in place is to use the Google Sitemap Generator at Audit My PC. http://www.auditmypc.com/free-sitemap-generator.asp

~JM~

[adverlicious]

I'm not sure I understand your question.

If you're using an automated tool to generate your XML site map (which you should be -- they're fast and free), why and how would you exclude any page that it finds during its spidering?

As long as you schedule a periodic refresh of your sitemap (nightly if you can automate it or daily/weekly depending on your posting frequency), you can easily have ALL your pages in your sitemap, even the newest and most obscure.

[itispals]

Hello Raj,
You need not worry if you add pages at a frequent rate.
But i hope these pages are not duplicate content.
There are plenty of sitemap generators. All you need to do is just get one of them.
Then visit Google webmasters/ section you will have further details.
For further details about sitemaps, please take a few minutes to read sitemapsbuckleupnow.com/2007/05/09/new-tech-news-big-4-search-engines-accept-on-sitemaps/
Hope this is useful.
If your site is well coded and you a site map, then surely the Google spiders should be in a position to find these pages. But adding site maps would now help your site to be accessed by MSN and AsK bots very soon...So you get this extra benefit....
thanks,
pals.
http://www.buckleupnow.com