web crawlers

[joy]

Is there a place to check your site, to see what web crawlers have and are looking at your site? Is there a way to see when they check it, so I can work on my keywords after they crawl?

[minstrel]

Joy:

Usually you would get that information from checking your site log statistics - if you don't know how to do that, check with your host.

[OleTom]

Hi joy :-)
They don't allways go by your meta tags I went to yahoo and entered these words:

free ways to advertise on the internet

My site came up in the top spot then I went to google and the same thing happened. this is not in my key words but is in the content.

I was checking the source code for a site one time and noticed they had a lot of key phrases down in the bottom of their index page the font color was the same color as the background I couldn't understand then but now I think I know why.
Just my 2 cents :-)

[joy]

Ole Tom wrote:
I was checking the source code for a site one time and noticed they had a lot of key phrases down in the bottom of their index page the font color was the same color as the background I couldn't understand then but now I think I know why.

But I don't understand what you mean, "you know why", what do you know? I am not sure what you are meaning, could you share with me what you mean, please. Joy

[minstrel]

I'm not sure what you meant either, OleTom, but the technique you describe is an old one, not a good one, and not one you should adopt if you really cares about your website - it may well get you penalized.

[OleTom]

I'm not sure what you meant either, OleTom, but the technique you describe is an old one, not a good one, and not one you should adopt if you really cares about your website - it may well get you penalized.

Well I think they did it to make it seem as they had more content then was seen on their page. I am not suggesting anyone should do that. I'm no expert on search engines but have noticed that they don't just go by the meta tags since the key phrase that brings me to the top of yahoo ,google and AOL "For that phrase" is not in my meta tags or even in one sentence on my site?
BTW I didn't even do it on purpose .

[minstrel]

Originally Posted by OleTom

Well I think they did it to make it seem as they had more content then was seen on their page. I am not suggesting anyone should do that. I'm no expert on search engines but have noticed that they don't just go by the meta tags since the key phrase that brings me to the top of yahoo ,google and AOL "For that phrase" is not in my meta tags or even in one sentence on my site? BTW I didn't even do it on purpose.

That technique is used as a method to add a lot of keywords to a page that spiders will read but vistors won't normally see. However, it isn't difficult to detect and will be interpreted as an attempt to deceive - which conceivably could result in the site being penalized.

If you have used the technique on your own site, OleTom, you might want to think about removing it.

[Gary Golden]

Hey Tom,

"free ways to advertise on the internet" When you start looking for long phrases it seems that search engines will look for each word independently with in your page as opposed to the shorter terms more commonly used.

Your title tags are singularly the most important part of any site, proper use of these tags will aid in your search engine placement. Though I might also say that spamming your title tags will not help you in the least!

Keep your keyword phrases short and relevant to obtain the desired effect.

[minstrel]

Originally Posted by Gary Golden

"free ways to advertise on the internet" When you start looking for long phrases it seems that search engines will look for each word independently with in your page as opposed to the shorter terms more commonly used.

That's correct - if the phrase is entered without quotation marks, Google will look for any of those words in any order.

If you put quotation marks around the phrase, Google will try to find the words in that order.

[Brother Ivey]

Originally Posted by joy

Is there a place to check your site, to see what web crawlers have and are looking at your site? Is there a way to see when they check it, so I can work on my keywords after they crawl?

Hi Joy,
I'm not sure if your question ever got answered so I'd like to make a suggestion. http://www.xav.com/scripts/axs/ is a site that offers a free vistor tracking script that I find works very well. You can view your logs and see exactly who or what (robots and crawlers) visited your site. There are tons of configurable options avaialable, and The script was fairly easy to set up from what I remember. However, there is a link on their page that states they offer free custom installs if your not familiar with perl scripts.
There's also a working demo on the page.

Hope this helps,
Bro. Ivey

[joy]

Thanks for the help! Joy