Google Spidering

Jerry Murray · #1 (**permalink**) 10-21-2005, 11:12 AM

I haver two sites for our dealership.

Site one is http://www.heritagehonda.net

Site two is http://www.heritagehondabaltimore.com

Now site #1 was last spidered Oct 11th, while Site #2 was done on the 20th. It seems that site #2 is spidered at least every day if not every other day. How can I get site #1 to spider more frequently?

Evic · #2 (**permalink**) 10-21-2005, 11:42 AM

Look into submitting a Google Sitemap, so Google knows how often your content is updated and when spidering should occur.

**crankydave** · #3 (**permalink**) 10-21-2005, 11:48 AM

Quote:

Originally Posted by Jerry Murray

I haver two sites for our dealership.

Site one is http://www.heritagehonda.net

Site two is http://www.heritagehondabaltimore.com

Now site #1 was last spidered Oct 11th, while Site #2 was done on the 20th. It seems that site #2 is spidered at least every day if not every other day. How can I get site #1 to spider more frequently?

Right now, Google is showing an old cache for a lot of sites. If this is something you just noticed, be patient.

Dave

ace1mc · #4 (**permalink**) 10-21-2005, 05:34 PM

I have been using google sitemaps for my sites for about 2 months now. I wasn't sure if it would make a difference to them. However I have begun to redesign my main web site. www.4iautos.com and the reason for it is. I used to have about a 1000 web pages listed on google. Now I have 22,500 pages listed. Meta tags are a big part of daily updating with searchengines.
I get MSN to update web pages Daily with all three of my web sites.
www.4iautos.com
www.4iautos.ca
www.4iautos.co.uk
Look at the meta tags you have on the web page.
Here are your tags on http://www.heritagehonda.net/

<title>Baltimore, MD Area Car Dealer Heritage Honda Parkville</title>
<meta name="keywords" content="heritage honda, parkville, baltimore, maryland, md, used car sales and financing, auto maintenance and service, new honda sales, accord, civic, cr-v, element, insight, odyssey, pilot, ridgeline, s2000 roadster, hybrid sedan">
<meta name="description" content="Heritage Honda is a Dealer with locations in Baltimore, Maryland and with a dedicated Service Center in Towson. New and Used, Civic, Accord, Odyssey, CRV, Element and Ridgeline.">
<meta name="distribution" content="Global">
<meta name="author" content="www.heritagehonda.net">
<link media="screen" rel="stylesheet" type="text/css" href="/Styles/Theme_0012/Variation_0001/Screen.css">
<link media="print" rel="stylesheet" type="text/css" href="/Styles/Print.css">
<script type="text/javascript" src="/Scripts/wmxScriptLoader.js"></script>
</head>

The problem with this one is you do not tell the Search Engines to visit the site daily for new content on this web site.

Second Web Site.
<title>Baltimore, MD Area Car Dealer - Heritage Honda Parkville</title>
<meta name="keywords" content="heritage honda, parkville, baltimore, maryland, md, used car sales and financing, auto maintenance and service, new honda sales, accord, civic, cr-v, element, insight, odyssey, pilot, ridgeline, s2000 roadster, hybrid sedan">
<meta name="description" content="Heritage Honda is a Dealer with locations in Baltimore, Maryland and with a dedicated Service Center in Towson. New and Used, Civic, Accord, Odyssey, CRV, Element and Ridgeline.">
<meta name="distribution" content="Global">
<meta name="author" content="www.heritagehondabaltimore.com">
<link media="screen" rel="stylesheet" type="text/css" href="/Styles/Theme_0092/Variation_0001/Screen.css">
<link media="print" rel="stylesheet" type="text/css" href="/Styles/Print.css">
<script type="text/javascript" src="/Scripts/wmxScriptLoader.js"></script>
</head>

Which is the same as the first web site.

You have to let the searchengines know that content is changing daily.
In which case on this web site it does not change daily. A simple trick would be to put some daily news onto the web page to show new content on the page daily.

Sincerely
Allen McCormick
ace1mc@4iautos.com

DaGrip · #5 (**permalink**) 10-21-2005, 09:39 PM

Good info ace1mc. I haven't come across the
<meta name="revisit-after" content="daily"> tag before. Has anyone else found it helps with spidering?

That's me off to add it to all my sites!

ace1mc · #6 (**permalink**) 10-21-2005, 11:05 PM

I know that a few of the search engines namely MSN uses this meta tag for sure. I can go in and see pages that I created two days ago for my News section that I have on my own web site. I do not use a RSS feed. I create a web page daily on all three of my web sites and have my web pages updated with this feed daily when I make the change.
So yes MSN does use it. It is a matter of having the change in and done before the spiders return each time. That way it does show that there is a change on the page.

Allen McCormick
ace1mc
www.4iautos.com
www.4iautos.ca
www.4iautos.co.uk

Sbabb · #7 (**permalink**) 10-21-2005, 11:43 PM

Color me confused!

I've read all over the place that the "revisit-after" tag isn't used by any of the major search engines at all. I've read that it was invented for a small search engine in Canada a long time ago and nobody else has adopted it.

The people writing this say that putting the tag in your HTML has no effect on anything and if you're getting visited daily by one or more major search engines, it's because you fit their particular criteria to get spidered daily, not because of the "revisit-after" tag.

I've also read that the Canadian search engine that used this tag years ago implemented it as a limiter, not an enhancer (i.e. "revisit-after 3 days" didn't tell the search engine to come back in 3 days, it meant to WAIT AT LEAST 3 DAYS before coming back, even if the search engine thought it was worth coming back twice a day!)

It looks to me like this is a (holy cow!) SEO Urban Legend!

Sbabb · #8 (**permalink**) 10-21-2005, 11:51 PM

Quote:

Originally Posted by Jerry Murray

I haver two sites for our dealership.

Site one is http://www.heritagehonda.net

Site two is http://www.heritagehondabaltimore.com

Now site #1 was last spidered Oct 11th, while Site #2 was done on the 20th. It seems that site #2 is spidered at least every day if not every other day. How can I get site #1 to spider more frequently?

Looking at the two sites quickly, it appears that the content that's probably most frequently updated would be the new and used car inventories, which probably change daily.

On the first site (which doesn't get spidered often) your links to that content appear to go off-site to another domain.

On the second site (which gets spidered daily) the links appear to go to pages on that same site.

My guess would be that Google sees the 2nd site as being updated at least daily, so it spiders it often and it sees the 1st site as not being updated as often because the updated content is on another domain.

If you can get the frequently-updated content on pages in the heritagehonda.net domain, Google may come back to it more often.

Jerry Murray · #9 (**permalink**) 10-22-2005, 05:16 AM

ace1mc

Thanks for your input. I went to your site and saw the meta tag that you referred to. It seems that Google last spidered your site 10/15, which is close to the last date they did mine 10/11

ace1mc · #10 (**permalink**) 10-22-2005, 08:04 AM

That would be for that page. However because I am redisigning the whole site to go with the State pages and to follow the other two web sites.
I am making changes in each state on a daily basis and have seen the new updates come line within a day or two.
You see Google and MSN will say when the last time they updated a certain page by it being spidered.

I have been designing and working on this site for 3 years now and am getting close to compleation on this automotive web site.
I make $50.00 a month right now with Google on my 3 Web sites. I get 75 Hits a day from Search Engines to my web sites.
Here is a good example of spidering.
I redid my Keywords for my Canadian Web site www.4iautos.ca This web site was getting 2-5 hits a day. It had been online for 5 months now. I made the changes 2 weeks ago and Last week I jumped from 2-5 hits a day to 30-50 Hits a day to the web site.
That is the type of example spidering can have a impact on a web site.

ace1mc
www.4iautos.com
www.4iautos.ca
www.4iautos.co.uk

ace1mc · #11 (**permalink**) 10-22-2005, 09:25 AM

So you know I have listed the Dealership on My Web Site. I have a Automotive Businesses Page for each State in the USA. I have listed your Dealership at www.4iautos.com/Maryland/Business.html

With a Link back To your Web site.

Sincerely
Allen McCormick
CEO
ace1mc
www.4iautos.com
www.4iautos.ca
www.4iautos.co.uk

mess · #12 (**permalink**) 10-23-2005, 01:18 AM

I have listed the Dealership on My Web Site

____________
http://www.super-referate.com/

greeneagle · #13 (**permalink**) 10-23-2005, 06:52 AM

Google spidering, except for "Media Partners" seems to have dramatically slowed during this update.

Ken

nuttymarketer · #14 (**permalink**) 10-23-2005, 09:37 PM

Google has launch Google Home page a long back. And you will be amazed to know that I have used that for getting all my website indexed in Google. Check my signature to know how.

But before that get a blogger account first. and start your own blog. Google And MSN Love blogs. Let me be very clear. You will have a lot of publicity from blogs.

Arvind Kumar

writergrrrl48 · #15 (**permalink**) 10-23-2005, 11:12 PM

Quote:

I'll parrot what an earlier poster said - "I'm confused."

I keep reading in the SEO forum that NOBODY uses meta tags, they are ALL WORTHLESS except for Title & description, DON'T BOTHER using meta tags.

This thread, however, indicates there are SOME meta tags that are useful SOMEWHERE.

What's a person to glean from this? None of you are "the expert", everyone is expressing opinions. How do I determine what is most likely to work for me?

thanks for any ideas ...

sysop9999 · #16 (**permalink**) 10-23-2005, 11:53 PM

writergrrrl48,

I'd use META tags. Simply to please MSN and Yahoo (and other search engines who still uses them).

The reason people say "don't use'em" is most likely based upon their own experience or hear-say, and if your page has alot of relevant (on topic) text, links etc. then Google is quite satisfied with that - in theory.

No one knows for sure what components are used when google determines PR and SE positions, so until we get a referenceguide from them, it's all theory.

It would be fun if some one could spare some alike domainnames, serverspace and time, and put up two websites with exact content - and leave out META tags on one of them. Then we'll have a more clear picture of it.

johnyfav · #17 (**permalink**) 10-24-2005, 06:43 AM

An on-topic good quality link would help with the spidering issue. As would quality content added daily.

I have a site that is updated with 5 news snipets a day and that gets hammered.

My hobby site gets updated once a week if I'm lucky and google follows that trend.

My 9-5 site gets new products/price changes all the time. We're talking 50+ changes a day. Google won't leave it alone. If I change a product price or add an option to a product it's on google in less than 2 days.

Hope that helps?

nuttymarketer · #18 (**permalink**) 10-24-2005, 10:17 AM

hey guys,

Are you saying that a site if get updated daily would be much higher ranked than a site updated in a week or so.????

Arvind Kumar

johnyfav · #19 (**permalink**) 10-24-2005, 10:30 AM

Quote:

Originally Posted by nuttymarketer

hey guys,

Are you saying that a site if get updated daily would be much higher ranked than a site updated in a week or so.????

Arvind Kumar

Not really - it will get spidered quicker though.