About Crawler

[Rajeev Ranjan Singh]

Hello
Everybody

Whats are the major diffrence between all the crawler system.

Whats are the thing that is common to all the crawler.

Thanks


Rajeev

[cbp]

Whats are the major diffrence between all the crawler system.
Whats are the thing that is common to all the crawler.

I have no idea what you are asking?

CBP

[Rajeev Ranjan Singh]

I want to ask.

There are lots of different web crawler in the web.
What are the thing that are common to all the webcrawler in crawling the website.( Like some crawler like to read to title tags only and some crawler like to see the meta tags of your website.)

so can anybody have idea. How they work.

[cbp]

From what I understand, all search engines crawlers read everything --- its the ranking algorithms at each search engine that place the different emphasis on different things (eg title tag, anchor text, keyword density etc)

CBP