PDA

View Full Version : Why don't they see them all?


LG07
04-20-2006, 01:43 PM
Hi
I wonder if anyone can tell me why some of my pages are spidered and cached by Google on a regular basis, why some don't seem to have been spidered for a couple of months and why some are never spidered?

How is this so and what can I do to make sure that the engines look at them all and register them?

Please help, I would very much appreicate it.

Thanks

Mandy

www.accolade-corporate-events.com
bobitza
04-20-2006, 05:07 PM
Happened to me also ... but in the end all the pages got spidered. When I looked at the internal links structure, usually the pages with less internal links to them, "finish last" :))

I think you can speed up the process by getting a few more links to those pages from your main ones.
JuniorOnline
04-21-2006, 04:22 AM
do you think the website gets indexed faster if you had adsense?
seharness
04-21-2006, 12:48 PM
I am inclined to think that it may have to do with the fact that the pages do not show up in text only cache.
http://72.14.203.104/search?q=cache:e9lcgg4-ZhgJ:www.accolade-corporate-events.com/+&hl=en&lr=&strip=1

I think it is important for many reasons to fix this and easy. Just add the HTML alt attribute. Make sure it represents your image text and not over optimization.

Good day to you,

J
seharness
04-21-2006, 12:49 PM
I am inclined to think that it may have to do with the fact that the pages do not show up in text only cache.
http://72.14.203.104/search?q=cache:e9lcgg4-ZhgJ:www.accolade-corporate-events.com/+&hl=en&lr=&strip=1

I think it is important for many reasons to fix this and easy. Just add the HTML alt attribute. Make sure it represents your image text and not over optimization.

Good day to you,

J
Irishjim
04-21-2006, 12:57 PM
Build an ror file and used anchored text in your in-site links.
plasma800
04-21-2006, 02:05 PM
What exactly is an ROR file and what does it do for you?



Also, that google non-html cache..... how do you get google to show you that for your own site?
katropa
04-21-2006, 07:34 PM
A ROR file looks like this:

<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:ror="http://rorweb.com/0.1/" >
<channel>
<title>Blue Widgets</title>
<description>We sell blue widgets at cut throat prices</description>
<link>http://www.blue-widgets.com/</link>
<language>en-US</language>
<item>
<title>SiteMap</title>
<link>http://www.blue-widgets.com/</link>
<ror:about>sitemap</ror:about>
<ror:type>SiteMap</ror:type>
</item>
<item>
<title>Blue Widgets</title>
<link>http://www.blue-widgets.com/index.html</link>
<ror:updatePeriod>week</ror:updatePeriod>
<ror:sortOrder>0</ror:sortOrder>
<ror:resourceOf>sitemap</ror:resourceOf>
</item>
<item>
<title>Blue Widgets for sale</title>
<link>http://www.blue-widgets.com/sales.html</link>
<ror:updatePeriod>week</ror:updatePeriod>
<ror:sortOrder>0</ror:sortOrder>
<ror:resourceOf>sitemap</ror:resourceOf>
</item>
</channel>
</rss>

Place this in your <head> section of your main page only:
<link rel="alternate" type="application/rss+xml" title="ROR" href="sitemap-ror.xml">

The file has got to be in your root directory

Rainer
mlmleads
04-22-2006, 09:51 PM
This is a related question. Is there a program that will search for a keword or other string in Google, yahoo and MSN and save all the URLS in a list that come up in the results?
incrediblehelp
04-23-2006, 03:10 PM
do you think the website gets indexed faster if you had adsense?

Nothing official has been said, but others (http://www.jensense.com/archives/2006/04/adsense_mediapa.html) tend to suggest that it might.
incrediblehelp
04-23-2006, 03:11 PM
usually the pages with less internal links to them, "finish last" :))

BINGO!
LG07
04-24-2006, 06:05 AM
Thanks very much for your advice everyone, it really is very much appreciated.
mjtaylor
04-24-2006, 12:40 PM
>>why some of my pages are spidered and cached by Google on a regular basis, why some don't seem to have been spidered for a couple of months and why some are never spidered<<

Yes, the fewest internal links seem to finish last ...

Another reason for the difference in how often pages are spidered, once they are indexed, has to do with how often the content changes. The more often content is updated the more often a page (and a site) is indexed.

On sites where a significant proportion of content changes daily - for example, a newspaper's site - the spiders visit and index daily.

M.-J. Taylor
JuniorOnline
04-24-2006, 12:42 PM
could you please clarify how we get them to index the pages that are updated daily? we have a news section updated either daily and sometimes every 2 days. yet last time we got indexed was 14th of April.