Mysterious inktomi visit

OtitO · #1 (**permalink**) 08-19-2004, 07:20 AM

Hi.
Just wanted to ask whether inktomisearch.com is an ISP in the US or not. Today I looked at my logs and found an unreferred visit from a server called inktomisearch and when I did the whois search I found that it is totally owned by yahoo.
Is it possible that it was a yahoo directory editor for example? You guys know better.
Thanks

ronniethedodger · #2 (**permalink**) 08-19-2004, 07:37 AM

That is the Slurp crawler. It should have a designation that looks something like this lj1069.inktomisearch.com.

Yahoo has not changed the designation yet (according to Tim Mayer at Yahoo). But all the registration information at WhoIs has been updated to Yahoo addresses other company information.

If you look at your server logs, you will also notice that crawler is identified in the User Agent field as Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp).

sfowler · #3 (**permalink**) 08-19-2004, 11:45 AM

Slurp has been busy with my sites as well. Not just visiting, but indexing as well! Looks like someone finally found the operating manual.

OtitO · #4 (**permalink**) 08-19-2004, 04:18 PM

Thank you guys I have just woke up had a cup of coffee waiting for a similar visit by google

Phiber · #5 (**permalink**) 09-01-2004, 04:57 AM

I'm on my fourth coffee (turkish style :-) and this is the 36th hour that I'm awake.

Yahoo is spidering my pages like crazy. (about 11000 of them)
Current position for a major keyword is 20. Gotta optimize the site for yahoo.

sfowler · #6 (**permalink**) 09-01-2004, 06:42 AM

It is getting better, but don't forget that the indexing comes an indeterminate time after the crawling. Just make sure you don't change things before you have seen where you end up after the indexing is complete.

Phiber · #7 (**permalink**) 09-01-2004, 06:59 AM

the content is changed daily. often, several times a day. I won't change any other SEO stuff.
This is the site: Computer Security Resource - Xatrix Security
sorry for the keyword link :-))

pne · #8 (**permalink**) 09-01-2004, 09:45 AM

Simon is absolutely correct.

I'm finding that top-level domains have been updated and second level domains are in the process of.

Check your site using site:www.yoursite.whatever. You may see some odd results. I find that pages in the process of being updated return URL rather than meta description.

pne