Submit Your Article Forum Rules

Page 2 of 2 FirstFirst 12
Results 11 to 15 of 15

Thread: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

  1. #11
    Senior Member Uncle Dog's Avatar
    Join Date
    Apr 2008
    Posts
    342

    Re: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

    No and Yes. The reason I like it is 'coz I let it go and it gets it for me. It's automated indexing, tweakable for min' word length, commonality etc. I fire it up every so often (could be cron) to keep the index fairly current, add sites as I stumble upon them and index them as I add them. I've adapted some code to allow for batch indexing, site status etc. The admin interface lets you weight keywords/urls/descriptions/titles etc to help tune your results... Hey! it's an algorithm. I've found where to fiddle with that bit too!

  2. #12
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    8,007

    Re: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

    Quote Originally Posted by Uncle Dog View Post
    PM me with a way to contact you and I'll send you the url.
    kbleivik at broadpark.no

    or

    kbleivik at gmail.com

    Write From Uncle Dog in the subject field.

  3. #13
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    8,007

    Re: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

    Quote Originally Posted by Uncle Dog View Post
    No and Yes. The reason I like it is 'coz I let it go and it gets it for me. It's automated indexing, tweakable for min' word length, commonality etc. I fire it up every so often (could be cron) to keep the index fairly current, add sites as I stumble upon them and index them as I add them. I've adapted some code to allow for batch indexing, site status etc. The admin interface lets you weight keywords/urls/descriptions/titles etc to help tune your results... Hey! it's an algorithm. I've found where to fiddle with that bit too!
    My bolding. Very interesting.

  4. #14
    Senior Member deepsand's Avatar
    Join Date
    May 2004
    Location
    State College, PA
    Posts
    16,647

    Re: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

    Precisely what is automatically indexed?

    PS : Please PM the URL to me.

  5. #15
    WebProWorld MVP kgun's Avatar
    Join Date
    May 2005
    Location
    Norway
    Posts
    8,007

    Re: Webmasters, forget browsers and SE's. Make your own ethical WebBots.

    Quote Originally Posted by kgun View Post
    In a smaller population it is much easier to introduce language as a third dimension. This was only one example. There are infinite other examples.
    Two examples:

    1. You construct a bot that sends you a SMS when a put price on the NASDAQ future crosses a treshold. Who pays for that SMS?
    2. You construct a bot that inform you as above or otherwise that there is too much traffic on your site.
    3. Alternativley there are too many bad bots (e. g. not respecting robots.txt) stealing your bandwith and content.

Page 2 of 2 FirstFirst 12

Similar Threads

  1. 30 Must See Web Generator for Lazy Webmasters. Smart webmasters do not work everythin
    By TrafficProducer in forum Graphics & Design Discussion Forum
    Replies: 0
    Last Post: 12-12-2009, 04:13 AM
  2. Se's plugins / alternative Se's.
    By kgun in forum Browsers
    Replies: 2
    Last Post: 12-10-2009, 12:28 PM
  3. Is this ethical?
    By weslinda in forum Search Engine Optimization Forum
    Replies: 90
    Last Post: 07-24-2007, 07:49 AM
  4. Is this ethical ?
    By DomainSage in forum Internet Industry
    Replies: 2
    Last Post: 08-31-2006, 03:31 AM
  5. Frontpage 2003 Webbots?
    By Basil in forum Web Programming Discussion Forum
    Replies: 2
    Last Post: 03-31-2004, 12:56 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •