Submit Your Article Forum Rules

Page 1 of 2 12 LastLast
Results 1 to 10 of 15

Thread: Search engines vs. Directories

  1. #1
    WebProWorld MVP minstrel's Avatar
    Join Date
    Jul 2003
    Location
    Ottawa, Canada
    Posts
    2,553

    Search engines vs. Directories

    Several threads recently have asked questions about directories like DMOZ/ODP -- one has a question about why Google's directory lags so far behind DMOZ. I came across an article (excerpted here) which makes reference to what I see as the fundamental problem with DMOZ or similar projects, including the "ESP" project mentioned here -- although well-intended, the exponentially increasing size of the internet makes it virtually impossible to keep up by reviewing each new site with "human hands".

    Associated Press
    October 17, 2003

    PITTSBURGH — Carnegie Mellon University researchers are using an Internet game to help improve artificial intelligence, in hopes of making Web searches more powerful. Graduate student Luis von Ahn and his mentor, professor Manuel Blum, believe search engines can one day adopt word labels generated by their ESP Game to help computers see images more as humans do.

    (snip)

    Search engines use algorithms — mathematical recipes designed to solve problems — to sort, rank and filter pages, text and images on the Internet. The ESP Game tries to improve upon that by asking two players who don't know each other to type in words that describe a series of images. Players win points when they match words — and those matches become labels Mr. von Ahn and Mr. Blum can affix to the image in question.It would take too long for researchers to label the hundreds of-millions of images that can be accessed by Google or other search engines. But Mr. von Ahn believes that task might be accomplished in a few months by getting a few thousand people to play the game each day.

    Spokesmen for Google and Alta Vista were mum on that prospect, and some industry analysts were skeptical. Sophisticated algorithms can track which sites help the most users with specific questions — and that's generally faster and cheaper than using a phalanx of human editors, said Danny Sullivan, editor of the on-line newsletter SearchEngineWatch.com.

  2. #2
    WebProWorld MVP mikmik's Avatar
    Join Date
    Aug 2003
    Posts
    1,557

    I knew you were going to say that

    I just read one estimate put it that 50,000 new sites, or maybe it was just pages(anyone? - can't remember where I read it), but some obscenely large number of new additions are posted monthly to the www !
    So how many pictures does that bring the total to now? Let's see, multiplied by about 30 differrent languages for starters (how many charsets I wonder?)
    and several descriptions of each picture - generated and analyzed by humans at the optimistic rate of one per minute = ... Somebody better send out for pizza, we'll be here a while! Anyways I know it is just to get patterns that AI bots could use but I think it would be far easier just to read "alt" tags myself, let alone get a program to interpret the visual information of graphics the way humans do.
    Don't tell Mr. von Ahn and Mr. Blum or it will ruin their day! Xml anyone?
    Babies don't need a vacation, but I still see them at the beach... it pisses me off! I'll go over to a little baby and say 'What are you doing here? You haven't worked a day in your life!'
    Steven Wright

  3. #3
    Senior Member zbatia's Avatar
    Join Date
    Jul 2003
    Posts
    137
    I have submitted RTEK2000.com to DMOZ long time ago (I believe more than 6 months ago) and it's still not there. I don't expect it to be there because the process of inclusion in the Directory is not authomated but rather is manual (see mikmik note above).
    The Cyber Teacher. http://www.rtek2000.com - Discounted Self-Study packages for IT certs
    http://www.800-webdesign.com/free-we...resources.html -Web Master's Resources

  4. #4
    Senior Member
    Join Date
    Sep 2003
    Posts
    171
    Although I agree it's time consuming and tedious, I see the wisdom in having at least one human-edited directory. The future is of course, with the spiders becoming more advanced though. The limitations of the system in the article were well pointed out by mikmik in just a few short sentences.

    The Martian
    Happy coding,
    The Martian

  5. #5
    WebProWorld MVP minstrel's Avatar
    Join Date
    Jul 2003
    Location
    Ottawa, Canada
    Posts
    2,553

    Submitting to DMOZ

    yikes... that title rather sounds like surrendering in battle...

    Quote Originally Posted by zbatia
    I have submitted RTEK2000.com to DMOZ long time ago (I believe more than 6 months ago) and it's still not there. I don't expect it to be there because the process of inclusion in the Directory is not authomated but rather is manual (see mikmik note above).
    Another problem is that, if you explore the DMOZ directory, you'll soon discover that a large number of categories have no editors... at least in categories relevant to my profession and website... since DMOZ explicitly tells you you can't submit to more than one category, what happens if the one you choose doesn't even have an editor?

  6. #6
    Senior Member
    Join Date
    Oct 2003
    Posts
    4,932
    Another problem is that, if you explore the DMOZ directory, you'll soon discover that a large number of categories have no editors... at least in categories relevant to my profession and website... since DMOZ explicitly tells you you can't submit to more than one category, what happens if the one you choose doesn't even have an editor?
    Every category has an editor. Editors in categories at a higher level can and do edit those categories that have no editor listed. 200+ editalls can edit any category.

    I noted the comment from mikmik re 50 000 sites or pages get added daily to the www - how many of those is DMOZ ecpected to add? 2000-4000 sites gets added daily to DMOZ (substantially more gets submitted).

    CBP

  7. #7
    Junior Member Derald's Avatar
    Join Date
    Jul 2003
    Posts
    22
    I am listed on DMOZ and 5 or 6 weeks ago I used the "update url" in my category to change the description, since I have expanded the services I offer.

    How long should I wait before doing it again? I don't want to irritate the powers that be.

    Derald
    mediarail design
    "Creatively intelligent communiciations."

  8. #8
    WebProWorld MVP minstrel's Avatar
    Join Date
    Jul 2003
    Location
    Ottawa, Canada
    Posts
    2,553
    Quote Originally Posted by cbp
    Every category has an editor. Editors in categories at a higher level can and do edit those categories that have no editor listed. 200+ editalls can edit any category.
    Yes, but as the higher level categories grow, which they do inevitably, that editor eventually runs out of time to properly attend to the subcategories - then a subcategory like "clinical services" (a hypothetical) ends up with maybe 7 or 8 entries, which isn't even a representative sample...

    I noted the comment from mikmik re 50 000 sites or pages get added daily to the www - how many of those is DMOZ expected to add? 2000-4000 sites gets added daily to DMOZ (substantially more gets submitted).
    ...and that is precisely the point: assuming your figures and mikmik's are accurate and assuming the maximum additions for DMOZ, that means they can index 8% of new sites daily -- they are doomed to fall ever farther behind. I am not trying to imply that the editors aren't working hard - I'm trying to argue that no matter how well-intentioned they are or how hard they work at that single task, the numbers are written on the wall: they cannot do what they are trying to do.

  9. #9
    Senior Member
    Join Date
    Oct 2003
    Posts
    4,932
    How long should I wait before doing it again? I don't want to irritate the powers that be.
    Don't do it again. Everytime you submit a site or an update, it overwrites the previous one. If the editor chooses to deal with the pool of suggestions by date, you will be putting yourself at the back of list.

    Also, your suggestion to change the description may have been rejected. In the category I edit I change almost all the descriptions and reject almost all suggested changes that are submitted as they do no meet the DMOZ guidelines (they are usually packed with keywords, and that is not acceptable).

    Best way is to go to http://www.resource-zone.com/ and ask the status - but PLEASE read the forum guidelines first

    CBP

  10. #10
    Junior Member Derald's Avatar
    Join Date
    Jul 2003
    Posts
    22
    Quote Originally Posted by cbp
    How long should I wait before doing it again? I don't want to irritate the powers that be.
    Also, your suggestion to change the description may have been rejected. In the category I edit I change almost all the descriptions and reject almost all suggested changes that are submitted as they do no meet the DMOZ guidelines (they are usually packed with keywords, and that is not acceptable).

    Best way is to go to http://www.resource-zone.com/ and ask the status - but PLEASE read the forum guidelines first

    CBP
    Thank you for your suggestion regarding the forums. I read the guidelines last night and I'll post today.

    I would like to change to correspond with my current meta tag description. It is not packed with keywords. Google seems to keep grabbing my old description from DMOZ when it dances.

    Thanks,
    Derald
    mediarail design
    "Creatively intelligent communiciations."

Page 1 of 2 12 LastLast

Similar Threads

  1. Search Engines or Web Directories
    By pshukla in forum Other Engines/Directories
    Replies: 8
    Last Post: 09-14-2009, 06:48 AM
  2. Blog Directories & Search Engines
    By AG_Spider in forum Internet Industry
    Replies: 0
    Last Post: 09-19-2005, 03:57 PM
  3. Indian Search Engines and Directories
    By narender in forum Search Engine Optimization Forum
    Replies: 6
    Last Post: 08-11-2005, 06:27 AM
  4. Fastest way to get listed in Search Engines and Directories
    By digiappz in forum Search Engine Optimization Forum
    Replies: 5
    Last Post: 04-08-2005, 11:15 PM
  5. italian search engines and directories
    By gireesh-nair in forum Search Engine Optimization Forum
    Replies: 0
    Last Post: 08-08-2004, 01:38 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •