View Full Version : Sitemap software not finding pages
05-25-2006, 03:07 PM
Hi: Having done a search through this forum and so having used recommended sitemap generators like xml-sitmaps (but also three or four other sitemap makers not listed in webproworld), I can't get a single generator to list all the pages in my directory, which is http://www.colorado.edu/English/. I always get at best just the files in the top directory. Site Map Builder, for example, just gives me one item under "urls processed": http://www.colorado.edu/English/. I am new to webmastering, and I suspect that I must be making some very foolish newbie mistake or assumption, but could someone please tell me what that error is? Thank you.
05-25-2006, 05:44 PM
I get good results with this: www.freesitemapgenerator.com/ (http://www.freesitemapgenerator.com/)
It goes 4 links deep for me.
05-25-2006, 05:51 PM
Look closely at your site if you are using JAVA or some other script based code for navigation though your site. Then you could have problems CRAWLing through the site. If you do this then you need to also have a very small text with funny colors on the bottom of your pages to make the links to the other top levels and possibly sub-levels of your site tree. This will allow the crawling agent to find your other pages.
05-26-2006, 12:04 AM
This is a good sitemap generator works perfectly on
my site no problems just follow instructions on site.
use code in meta tags as instructed if you want to call file sitemaps.xml instead of sitmaps.ror
05-26-2006, 04:21 AM
have you tried sitemapspal (http://www.sitemapspal.com)?
Would it be possible to do it manually? I started off using AutoSiteMap but got tired of the logo on my site after a while. I took the XML file generated by this tool and used it as a template to create my own manual sitemap.
05-26-2006, 11:48 AM
Okay, did anyone visit this site before posting? Using IE 6 on an XP Pro Machine, this site simply freaks out. Images won't load, JS has issues, there are lots of problems.
Colr, I'm not sure why you would condone a JS menu on any page at this point. As more and more people are turning JS off for security reasons, this could make this site simply inneffective at best. Always offer an alternative on navigation.
The first thing I would do, before approaching anything regarding a site map is cleaning up the site, and moving to either a text based menu, or a CSS style menu that uses clean styles to represent the menu you are trying to produce.
If you take this page over to a Validator, it gets killed. Only 67 errors. I would work through these, and get the code cleaned up, then you can try a sitemapper again.
Also, make sure your sitemapper can read external .js files, as none of your links are actually in the pages.
Finally, you are probably spending more time on this than if you simply went out and made your own site map.
Feel free to PM me to get more help with your site.
05-27-2006, 12:47 PM
Hi, Folks: First, thank you very much for all the advice. I finally just included some HTML hyperlinks on the index page, and the sitemap generators seem to see the rest of the site's urls just fine.