iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Webmaster Resources Discussion Forum Sitemaps and robots and logfiles -- Oh My! If you have any questions, comments, concerns and/or ideas about the tools currently available to webmasters to make their lives... 'easier'. Here's where you need to be. Know of a good tool? Post it here. Got something funny in your logfiles? Maybe we can help.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 03-17-2009, 03:51 PM
fctoma's Avatar
WebProWorld Pro
 
Join Date: Jan 2004
Location: The best hiking and fishing - Idaho
Posts: 119
fctoma RepRank 1
Default Need a good Sitemap Generator for Dynamic Sites

Can anyone direct me to a good sitemap generator (preferably XML) that will create a site map for a dynamic site?

The site map creator I use now creates links (on the sitemap) that has references to temporary session ID’s? Those are dynamically generated each page load.

Also, the top 20 items are also generated based on real time sales figures at the time the page loads, so they are not static.

ANY help much appreciated

Kind regards,

Frank
__________________
Living the life in the Idaho Falls and playing Disc Golf
Idaho Falls SEO
Reply With Quote
  #2 (permalink)  
Old 03-17-2009, 05:50 PM
Dubbya's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Nov 2006
Location: Steinbach, Manitoba, Canada
Posts: 1,300
Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4
Default Re: Need a good Sitemap Generator for Dynamic Sites

You Can't go wrong with GsiteCrawler
Google Sitemap Generator for Windows :: GSiteCrawler

It finds everything.
Reply With Quote
  #3 (permalink)  
Old 06-14-2009, 10:33 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,167
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default Re: Need a good Sitemap Generator for Dynamic Sites

Quote:
Originally Posted by Dubbya View Post
You Can't go wrong with GsiteCrawler
Google Sitemap Generator for Windows :: GSiteCrawler

It finds everything.
Are you sure? XML Sitemaps and XML Sitemaps
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
  #4 (permalink)  
Old 06-15-2009, 10:38 AM
Dubbya's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Nov 2006
Location: Steinbach, Manitoba, Canada
Posts: 1,300
Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4
Default Re: Need a good Sitemap Generator for Dynamic Sites

I'm sure enough.

Feel free to recommend an alternative!
Reply With Quote
  #5 (permalink)  
Old 06-15-2009, 01:09 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,167
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default Re: Need a good Sitemap Generator for Dynamic Sites

Quote:
Originally Posted by Dubbya View Post
I'm sure enough.

Feel free to recommend an alternative!
So you are saying that it will obey to:

1. X-Robots of an .htaccess file?
2. Noindex and Allow robots.txt directives?
3. Noindex and Noarchive meta robots directives?
4. Wildcards in Robots.txt?

Correct?

About an alternative? I do not know any. That is why I am asking.
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO

Last edited by Webnauts; 06-15-2009 at 01:15 PM.
Reply With Quote
  #6 (permalink)  
Old 06-15-2009, 02:27 PM
Dubbya's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Nov 2006
Location: Steinbach, Manitoba, Canada
Posts: 1,300
Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4
Default Re: Need a good Sitemap Generator for Dynamic Sites

In cases where it does list files you don't want in the sitemap, simply go through the list of files and uncheck them to exclude them.

I've sent a message asking the creator to explain how to set GSiteCrawler up to follow the current robots.txt, .htaccess files and meta tag directives such as "noindex" and "nofollow".

I'll post his response later.
Reply With Quote
  #7 (permalink)  
Old 11-06-2009, 02:29 PM
WebProWorld New Member
 
Join Date: May 2009
Posts: 20
Denit RepRank 0
Question Re: Need a good Sitemap Generator for Dynamic Sites

Quote:
Originally Posted by Dubbya View Post
In cases where it does list files you don't want in the sitemap, simply go through the list of files and uncheck them to exclude them.

I've sent a message asking the creator to explain how to set GSiteCrawler up to follow the current robots.txt, .htaccess files and meta tag directives such as "noindex" and "nofollow".

I'll post his response later.
How creator respond to it ?
Reply With Quote
Reply

  WebProWorld > Webmaster, IT and Security Discussion > Webmaster Resources Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Pls help me for Sitemap generator wqamar Search Engine Optimization Forum 4 03-19-2009 07:33 AM
Sitemap generator duongo75 Search Engine Optimization Forum 3 10-08-2007 06:32 AM
A good free sitemap generator that works for MSN Search. WebMasterKrames Search Engine Optimization Forum 2 02-09-2007 12:18 PM
where to get a good sitemap generator lukkyjay Google Discussion Forum 18 12-18-2006 10:08 AM
Freeware Sitemap generator No Clue Search Engine Optimization Forum 3 06-20-2005 11:53 AM


All times are GMT -4. The time now is 12:28 PM.



Search Engine Optimization by vBSEO 3.3.0