WebProWorld - View Single Post

kgun · #2 (**permalink**) 06-05-2007, 09:09 AM

Is this posted in the correct forum? I have given my comments here,

but can repeat them for those who do not want to scroll those posts.

"Some comments.

Isn't that what a news Bot does?
How representative will it be? I would like to see the algorithme that searched x% of the sites on the internet in y seconds.
Isn't it a great danger that that engine will be a "spamengine"?
Note that the index of a SE is checked for quality by advanced filters and algorithms.
IMO, quality portals like Business.com - The Business Search Engine® and Business Directory for Business Information will increase in importance, since more and more spam / scam is found on the SERP's. Is there a scientific report of how much scam is found on the SERP's? More precisely, how many (% of eShoppers) have bought from a site they found on the SERP's without ever seeing the product / service?
There is no lack of information on the internet. Sooner the opposite. The problem is to find the correct one. I think it is not difficult for a BOT programmer to make such an engine. The problem is how good it is by different measures, some of them mentioned above.
Web services, web applications and XML powered sites with one uniqe source and many applications is the future. More precisely, you transform the XML node tree to another node tree like HTML, XHTML, PDF, WAP, DocBook, eBook, RSS, etc. etc. SE's have to be much more advanced to index and rank such sites. As I see it this is the greatest threat to the traditional SE's. To be more precise, SE's are good at indexing tagged data, but today, not so good at indexing webapplications like AJAX

P.S. Think of it millions of sites with billions of pages. How should a BOT be able to search a reasonable part of those sites in a reasonable time, even if

The search was in linear time? You have to know search alogorithms to know what this is about.
Even if the SE was spread over n datacenters? Who has the financial resources to compete with Google? Who has the human resources to manually intervene with the search algorithm and make it better?
What about bandwith, sites down, hight traffice, slow connections, a growing memory of the BOT(s) as it (they) visit(s) more and more pages?

I do not think Google or other serious SE companies fear this SE. But I shall give it a chance and see how relevant the SERP's are. And I do not think that a serious programmer will ever try to make a real time search engine that can compete with a database / archieve based SE."