Link Reform To The Rescue
Okay, I can't wait any longer. I've had this in the works for a couple months and now that Andy…
Part of the
network
network
Tag: robots.txt
10 Ways to Ensure Your Site Does Not Get Indexed on Search Engines
Search Engines have come a long way since the web's beginnings. Back in the old days it seemed like anything…
Hot Banana Upgraded With Improved Search Engine Optimization Features
Hot Banana Software Inc., Web Content Management System (CMS) company, has significantly enhanced its current version of Hot Banana to…
Why Robots.txt?
I am sure that a lot of you have heard of the file named robots.txt (also called a "robot exclusion…
Search Bots Behaving Badly
In a classic bit of Internet history (1998/12/30), a newsgroup member explained the GoogleBot to a poster complaining of its…
Disabling Google and Other Search Engines From Crawling a Site
Reader question: I have a online database of horror movies, and I have a good Google rank. In my traffic…
Tips to Protect Your Downloads or Products
1. Upload robots.txt file in to your root directory and include the folder name where you set your downloads.
How Deep into Your Site Are the Spiders Crawling?
Have you ever wondered how far down into your site the search engine spiders are going? Are the pay inclusion…
Stopping and Directing Web Spiders
Not all agents, (otherwise known as crawlers, bots, robots and spiders), that visit your site will be of benefit. Even…
Software to help you create a robots.txt file
Robogen is a software for Windows 95, Windows 98 and Windows NT based computers which can help you create robots.txt…
