Watching Google through Stats... crazy links???

jettrue · #1 (**permalink**) 03-07-2005, 09:01 AM

OK, I've redesigned a website for an established business friend of mine. We went with a Zen cart, which is of course a dynamic site. Her site before was a mix of static content, and a smaller amount of dynamic content.

She's been around for years, and is well indexed by google. Nothing greatly special, but at about a PR of 4. Her business is more about repeat customers than search engine business, so it's not a major priority.

ANYWAY, my point is this. The site is now using mod_rewrite and .htaccess to turn the dynamic links into static links.

The new site has been up less than a month, and the new pages have already been indexed by Google. Great.

The problem is, looking in the site stats, google is running through that site almost incessantly. And the links are mostly wrong links that it's spidering through.

when a link is categories/Baby-Gear/Clothing/Angel-Pants
it will be spidering things like:
categories/Baby-Gear/Clothing/Angel-Pants/categories/Baby-Gear/contact_us

or links that don't finish, like categories/Baby-Gear/Clo

I don't understand, WHERE google is getting these links FROM, and why it keeps spidering over and over and over...

But yet when I do allinurl:sitename.com, it comes back with correct links, and just about all the new content has been indexed correctly.

And I guess I shouldn't complain that Google is indexing often, but crap, she's already halfway through her bandwith 7 days into the month...

**ctabuk** · #2 (**permalink**) 03-07-2005, 09:14 AM

Hi, if you post the URL someone will take a look see. Cheers

jettrue · #3 (**permalink**) 03-07-2005, 09:17 AM

the link is:
http://www.fullmoonbabygear.com

Oh, and as a note, I ran the site through Xenu's Link Sleuth... and no problem URL's popped up, everything was good...

**ctabuk** · #4 (**permalink**) 03-07-2005, 09:35 AM

You must be physic I have just this minute posted a reminder to use xenu

jettrue · #5 (**permalink**) 03-07-2005, 09:47 AM

So THAT's why a little voice in my head was whispering... "Xenu....Xenu....Xenu..." ;)

**ctabuk** · #6 (**permalink**) 03-07-2005, 09:57 AM

Yup, now I've just run the site through IPB, perfect, no problems any where except for the Spider Friendly, it does look a bit cluttered. Also on the search term 'babygear' you might want to take a look at Googles top choice www.babygear.com and do a comparrison. You might find it of interest!!!! More complaints about Big G about to erupt. But I can find nothing wrong with it.

jettrue · #7 (**permalink**) 03-07-2005, 03:06 PM

One thing I wonder...there was about a day and a half, when the programmer was developing the code for the search engine friendly links, when things were kind of wacky...perhaps google picked up some of those links, and is still trying to hold on to them?

Though that wouldn't explain the links that are incomplete...