how does spider see my website ?

varun8211 · #1 (**permalink**) 05-16-2008, 03:43 PM

I saw 100s of spider simulators on web and all showing different results.

Can someone, please help me the most useful and authentic simulator that clearly depicts what and how does the spider read my website pages ?

kgun · #2 (**permalink**) 05-18-2008, 10:22 AM

Quote:

Originally Posted by varun8211

I saw 100s of spider simulators on web and all showing different results.

Can someone, please help me the most useful and authentic simulator that clearly depicts what and how does the spider read my website pages ?

You find the best I know of here: http://www.surftoolbar.com/

Dubbya · #3 (**permalink**) 05-18-2008, 12:05 PM

kgun, there appears to be a problem with the surftoolbar site.

You sure that's the right link?

kgun · #4 (**permalink**) 05-18-2008, 12:23 PM

Scroll down to SE spider simulator.

**wige** · #5 (**permalink**) 05-19-2008, 09:45 AM

Kgun, I get:

Forbidden

You don't have permission to access / on this server.
Additionally, a 403 Forbidden error was encountered while trying to use an ErrorDocument to handle the request.

Webnauts · #6 (**permalink**) 05-19-2008, 08:16 PM

Quote:

Originally Posted by wige

Kgun, I get:

Forbidden

You don't have permission to access / on this server.
Additionally, a 403 Forbidden error was encountered while trying to use an ErrorDocument to handle the request.

The same here.