SE bots / spiders are automated software programs that crawl websites expecting to find web pages that adhere to a basic stucture (this is set by a doctype). If the document is well-formed HTML or XHTML, the spider will look for page's title and meta tags within the header area.
If they fail to find the title & meta tags within the header they will simply report a null/zero value for these elements.
|