iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Google Discussion Forum Google Discussion forum is for topics specifically related to Google. There is a subforum dedicated to AdSense/AdWords subjects.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 09-12-2004, 07:06 PM
WebProWorld Veteran
 
Join Date: Jul 2004
Posts: 913
activeco RepRank 2
Default Crawling non-linked pages?

I have a subdomain like test.domain.com, which I use for testing purposes before I upload a final page on right location.
It is not linked from outside world neither it has adsense or other code, but yesterday I noticed Googlebot crawling the directory!
OK, there is no robots.txt on that site, but I am still puzzled how they found it.
Any ideas?
Reply With Quote
  #2 (permalink)  
Old 09-12-2004, 07:32 PM
cbp cbp is offline
WebProWorld 1,000+ Club
 
Join Date: Oct 2003
Posts: 4,938
cbp RepRank 1
Default

Via the toolbar.
Did it get listed?

CBP
Reply With Quote
  #3 (permalink)  
Old 09-13-2004, 03:01 AM
WebProWorld Veteran
 
Join Date: Jul 2004
Posts: 913
activeco RepRank 2
Default

Quote:
Originally Posted by cbp
Via the toolbar.
Did it get listed?

CBP
Hmm, I am not sure I ever used win machine to look at the page (that't where my toolbar is), but it's possible.
It is not listed (yet), probably because of duplicate content.
Reply With Quote
Reply

  WebProWorld > Search Engines > Google Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 11:55 AM.



Search Engine Optimization by vBSEO 3.3.0