Re: Slurp Chewing up 20+ gigs per Month per Site
{quote}User-agent: Slurp
Disallow: /images/
ok thanks! ;0{/quote}
{quote}
Oops, sorry. The mind has trouble believing anyone prefers using a Windoze server in this day and age . . . {/quote}
i have over 500 websites, some use php, some use asp & some use .net .. i love my asp sites as they do some slick things I have not got around to doing on php yet
Last edited by glinted; 07-07-2007 at 04:13 AM.
|