View Single Post
  #8 (permalink)  
Old 02-04-2008, 05:54 PM
GizGaz's Avatar
GizGaz GizGaz is offline
WebProWorld New Member
 
Join Date: Jan 2008
Posts: 9
GizGaz RepRank 0
Default Re: Excluding the "good" BOTS from /images folder

Hi memaggiem,

This is the robots.txt files I'm using on my website;

# robots.txt for Example Web Page

User-agent: *
Disallow: /cyberworld/map/ # This is an infinite virtual URL space
Disallow: /tmp/ # these will soon disappear
Disallow: /foo.html
Disallow: /images

I hope this works for you, keep us posted!

Thanks,

GizGaz -=*L*=-
Reply With Quote