WebProWorld - View Single Post - Is the robots.txt header imp? Html or plain text?

AjiNIMC · #2 (**permalink**) 06-13-2006, 06:51 AM

There was a mistake with the header posted. The corrected header to the working domain Y is,

Code:

HTTP/1.x 200 OK
Date: Tue, 13 Jun 2006 06:28:33 GMT
Server: Apache/1.3.36 (Unix) mod_fastcgi/2.4.2 mod_gzip/1.3.26.1a mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.4.2 FrontPage/5.0.2.2635.SR1.2 mod_ssl/2.8.27 OpenSSL/0.9.7a
Last-Modified: Tue, 02 May 2006 08:44:40 GMT
Etag: "3801cb-132-44571bf8"
Accept-Ranges: bytes
Content-Length: 306
Content-Type: text/plain
Age: 11710
Connection: keep-alive

here the Content-Type: is text/plain

Thanks,
AjiNIMC