Your robots.txt is also blocking something..
Does the html fall under one of these directories?

# Disallow crawling of sub-site
User-agent: *
Disallow: /site/
Disallow: /common/roar/redir
Disallow: /common/roar/results.htm

__________________
Whipnet's RSS Feeds