How Long for a new domian

[Fingers]

New Domain www.custodiancomputers.co.uk

3 mth old now.

Google indexed it within 1 week. As did Yahoo OR SO I THOUGHT.

site:www.custodiancomputers.co.uk returned all my pages in yahoo about 2 weeks after the site was published. BUT now the site is no where to be seen?

Why would this happen?

[Dave Hawley]

You are in Google, search for www.custodiancomputers.co.uk

[ronniethedodger]

Uh, Dave, that is what he already said. It is in Google.

I don't know why it is not in Yahoo. Perhaps because you have no links to the site for one reason. I cannot find any at Yahoo -- except maybe one Guestbook entry. Work on more backlinks to your site for it to be found.

Seeing it in Yahoo at that one time you looked, it may have been that Yahoo was pulling results from the Google index. Have you looked at your server logs to see if Slurp has paid the site a visit yet?

[Dave Hawley]

BUT now the site is no where to be seen?
I thought that was in reference to both SE's.

[Fingers]

These are the only logs of slurp since the sites launch which was 23/06/04. So Yahoo has been it looks like. I am not using robots.txt which is it is looking for, will this make a difference?


66.196.90.114 - - [13/Jul/2004:20:05:58 +0100] "GET /custodian1/robots.txt HTTP/1.0" 404 - "FROM -" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
66.196.90.153 - - [13/Jul/2004:20:05:58 +0100] "GET /custodian1/ HTTP/1.0" 200 18852 "FROM -" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"

66.196.90.200 - - [15/Jul/2004:09:51:24 +0100] "GET /custodian1/ HTTP/1.0" 200 18854 "FROM -" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
66.196.90.117 - - [15/Jul/2004:09:51:24 +0100] "GET /custodian1/robots.txt HTTP/1.0" 404 - "FROM -" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"

[ronniethedodger]

The robots.txt file should not make a difference. Although, you should probably have one. Most of the SE guidelines "suggest" it and no telling what Slurp does if it does not find one. But, I repeat ... it should not make a difference in having your site crawled.

It does appear that Slurp is pretty much ignoring you. What you saw in the Yahoo index previously, was more than probably old Google results. You just happened to catch the results at the right time. They do no use them all the time, and at the end of the month it will be history.

I think you will need to work on getting some backlinks to spur Slurp on a little more. A lot of people have NOT been crawled by Slurp with any reasonable amount of frequency, so you are not alone on this. The links should definitely help improve that though.

Also, since Slurp has crawled your home page twice and I can see that there is only 2 bytes difference between those crawls -- it may appear to Slurp that your Home Page does not change. Perhaps adding a couple of K to the page (or losing about as much) will pique it's interest more. I do this from time to time, even though not much changes ... hehehe. And with bots in general, they think something new has been added. It usually sparks (googlebot anyway) into crawling a little deeper.

You also seem to have got a response out of Slurp rather quickly anyway. Usually it has taken some people about 8 or 9 weeks to even see Slurp at their front door. So ... in that respect you are doing okay. I would keep working on those links and make sure it does not lose interest.

[Fingers]

Cheers for that Ronnie I was starting to think Yahoo thought I was smelly :)

I have been working hard on links and expect to have some good links when those pages get updated.

I also have been editing all the site pages regularly. :)

Guess I just have to wait.

Thanks again