A Robots.txt question

braknews · #1 (**permalink**) 08-19-2004, 04:54 PM

I was looking at someone else's robots.txt & I saw the following:

Code:

User-agent: Googlebot-Image
Disallow: /
User-agent: Googlebot
etc.

Does that mean there are two or more types of Googlebot?
If I was to incorporate the same change into my robots.txt could I then block Google from indexing the image files in my site?

I thank you all in advance for any advice on this matter.

braknews · #2 (**permalink**) 08-19-2004, 05:14 PM

I just managed to find the answer to my own question on the Google site here.

Sorry for wasting everyone's time.

synergytheory · #3 (**permalink**) 08-20-2004, 03:24 PM

Quote:

Originally Posted by braknews

I just managed to find the answer to my own question on the Google site here.

Sorry for wasting everyone's time.

I wouldn't block googles image bot, a lot of people use the image search. Speaking personally, I've came across some great sites through an image search.

braknews · #4 (**permalink**) 08-20-2004, 03:31 PM

As part of a ("licensing") agreement I have to try & stop search engines indexing the images from my site & let them be picked up on the owner's.

Sounds daft but I get the images for free so I am not complaining.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode