PDA

View Full Version : Burf.com Search engine



Burf.com
03-09-2006, 08:55 AM
Does anyone think its worth me explaining how this works and doing a question and answer session on it?

Burf.com
04-13-2006, 11:17 AM
I guess not

Well I thought I mention some stuff anyway

Burf.com did index 5 millions sites until yesterday when I wiped the database to start again

It indexes every page submitted to it (full text) and then scanns the page for links and indexes them.

It recieves around 20,000 submission a day and tries to index a page within 1 minute of the submission, usually its instantly done.

The code for the engine is written in equinox and is the only SE out there to be done in this. First versions of Mirago used Equinox.

I hope to get around 10 millions sites indexed by the end of the month ( about 300gb of data)

kohsis
04-23-2006, 05:40 PM
How slow is this site? You should get yur site rated, like on alexa or something...I can't imagine how slow it will be with 300 gb of data..?#$%^

Burf.com
04-23-2006, 05:54 PM
Yeah I guess you took offence to my comment

Yes my engine is pretty slow because it uses its own index and does not reply on any other engine or service. The search part also runs of a different server

Alexa rating is 42,753 and speed rating of

Speed: Fast (62% of sites are slower), Avg Load Time: 1.5 Seconds

webmaker
04-24-2006, 08:18 PM
Everyone should understand that most of the speed comes from our caches. I am not sure about how burf stores his results and then presents them. Mine is not cached until after someone does the first search. This is the only way us small guys can keep our own results. I have tested Burf out and think that his results come up just fine and timely. Also, you should take into consideration that Burf and Yoddle are using the open ROR xml format. You are not just restricted to Googles sitemap requirements. Not to mention that Google and all other search engines can follow the ROR format just fine. Lastly, if you are having trouble getting your site indexed by one of the Big Guys. Us smaller engines do get indexed by all of the others. So maybe us smaller guys are not so bad after all. If people would help us a little, engines like Yoddle and Burf would be great starting places for new and existing sites.

Burf.com
04-25-2006, 03:03 AM
Well said, and thanks for the idea of the cache as I dont use one yet. I always spend so much time on create good results

I think I go an check Yoddle out more!

Burf.com
04-29-2006, 11:03 AM
You can now add search engine functionality to your site in minutes!

You also get a free myBurf account and static link

http://www.burf.com/beta/add_search_engine.php

Let me know what you think! (except its slow which is my next thing to solve)

webmaker
05-01-2006, 10:27 PM
Now all I need from Burf is an XML/Data feed. Then I could include your results and they would get cached as well.

Burf.com
05-02-2006, 10:21 AM
Ok well mate send me an example of what you want (e.g xml layout) and how you want to get it (e.g url)

and I do it!

ericgates
05-11-2006, 10:26 PM
Burf.com seems promising! I like the look and feel, although the top banner table does throw me off a little. I'm excited to see how this site pulls. I'll keep an eye on it for ya...

Burf.com
05-12-2006, 03:12 AM
Hello Mate

Interested in your feedback, what part do you think is wrong, the top section with the banner and search in it?

Very interested in your views

leesw
05-12-2006, 12:05 PM
I added my links! Thanks!

bj
05-13-2006, 10:34 AM
I just submitted last night and I'm showing up well for all my chosen keyphrases today, whereas yesterday I wasn't even a blip on the screen. Cool!

Burf.com
05-13-2006, 01:08 PM
Cool I am gald it works (most the time :) )

webmaker
05-19-2006, 12:17 AM
Ok well mate send me an example of what you want (e.g xml layout) and how you want to get it (e.g url)

and I do it!
yes.yoddle.net/cgi-bin/yes/include.cgi?keywords=health&show=10&external=1&xml=1 (http://yes.yoddle.net/cgi-bin/yes/include.cgi?keywords=health&show=10&external=1&xml=1)
Hey Big Guy,
Here is my xml output right now. If you can produce this format I could include your results with mine. If you look over in my little section you will see other ways to include my results with yours. It has been awhile. Everything going good?
Later.

adbart
05-19-2006, 06:59 AM
Hi Burf, I just noticed something about your search engine.

If you type in something which only has 1 result, then you still get the "no matches found" message following the results.

For example, a search for 'golf balls' results with my site there, but underneath, the message:


Sorry no matches were found, please try changing your search criteria.

Have a look.....

adbart
05-19-2006, 06:59 AM
By the way, your site is looking good now :-)

Burf.com
05-19-2006, 10:11 AM
Hey mate, thanks for the feedback, will fix it tomorrow

Any feedback on bugs is great, going to write a caching feature tomorrow so the site is much faster!

Burf.com
05-19-2006, 10:14 AM
I searched for golf balls and got alot of matches, maybe the engine was down?

But again thanks for feedback

Burf.com
05-22-2006, 11:28 AM
Burf.com has caching (well sort of)

It basicly caches any searches down and re caches them daily. So when someone else searches for say seo, it returns that and it seems to be alot faster.

Let me know if anyone has any ideas on this

Burf.com
05-30-2006, 08:35 AM
Anyone fancy trying this yet?

brian.mark
05-31-2006, 11:15 AM
I submitted my two sites yesterday and saw some bot action. All I can say is - impressive. I'm ranking for virtually everything tool or part related now. Great engine... well done... just don't tell my competitors and get a ton of traffic. ;-)

Oh, but the second time I search for something I get zero results. The cache might not be working quite right.

Brian.

Burf.com
05-31-2006, 11:51 AM
Could you pm me the search terms please mate so I could check the cache?

remember you can add this engine to your site for free :)

Webnauts
06-05-2006, 11:34 AM
I tried to submit our site at burf.com and I got this error message twice:

ESP compiler errors for /submit.esp

Line 63 - Error 7630: Unknown variable, object name or statement at ' AddressLen'
Line 77 - Error 7630: Unknown variable, object name or statement at ' AddSentMail'
Line 77 - Error 12960: This item cannot be converted at ' false'

Burf.com
06-06-2006, 07:59 AM
Fixed, I was doing some developement that I forgot to test

Webnauts
06-06-2006, 09:27 AM
Now it worked for me. I am looking forward getting indexed.

Burf.com
06-07-2006, 03:55 AM
If it does not then let me know, Sorry its been slow but been trying to index more sites!