View Single Post
  #9 (permalink)  
Old 06-06-2006, 05:07 AM
danners02 danners02 is offline
WebProWorld Member
 
Join Date: Nov 2005
Posts: 93
danners02 RepRank 0
Default Crawling

Your directory structure will effect which pages are crawled though, the higher the pagerank of a page the deeper (inside directories) spiders will crawl links from it (i belive?).
Reply With Quote