A heaping dose of Battle Bots and movies like Terminator and I, Robot have instilled a (healthy?) paranoia of centrally controlled robot futures – at least in the States. In South Korea, not so much, as the country announced its plan to have a robot in every home – very, very soon.
Anybody Care That The Robots Are Winning?
This shift to contextual advertising caused by intelligent software has privacy advocates going squirrelly, particularly because the larger public seems relatively unconcerned. After all, says the public, it’s all about the end-user experience, not whether a robot saw my iTunes list or my Gmail inbox and made a suggestion.
Japan Surrendering Moon To Robots
The Japan Aerospace Exploration Agency imagines a future where humanoid robots populate a lunar base in 2025.
Why Robots.txt?
I am sure that a lot of you have heard of the file named robots.txt (also called a “robot exclusion file”) before. But what does this file really pertain to? Basically you can think of a robots.txt file as a list of rules that search engines follow when they spider your site. A robots.txt file gives you the Webmaster a say in what does and does not get indexed when spiders come to your little corner of the web.
How to Create a Site That Will Be Liked by People As Well As by Robots
Why would you want a site?
Why indeed? The unceasing growth of the World Wide Web has resulted in an enormous number of sites, and new ones show up daily. Why would you want to create more? And what do you think about the widespread opinion that the Internet has been made for evil, and that people may get permanently lost there, breaking their connections with real life and all its virtues?
Software to help you create a robots.txt file
Robogen is a software for Windows 95, Windows 98 and Windows NT based computers which can help you create robots.txt files without having to worry about the correct syntax of a robots.txt file. It comes in two editions: the free Limited edition and the Standard edition which costs $12.95. You can get Robogen here.
Creating a Robots.txt file
Some people believe that they should create different pages for different search engines, each page optimized for one keyword and for one search engine. Now, while I don’t recommend that people create different pages for different search engines, if you do decide to create such pages, there is one issue that you need to be aware of.
Sitemaps and Hypertext Links: “Food” for Search Engine Robots
Sitemaps and hypertext links are “food” for search engine robots. We will look at the value of text links for optimal spidering, and the importance of using a sitemap in order to help search engine robots reach your website’s deeper pages.
Search Engine Robots – How They Work, What They Do (Part II)
Why Isn’t My Website In The Search Engine?
If your site isn’t found in the search engines, it is probably because the robots couldn’t deal with it. It could be something as simple as not being able to find the site, or it may be more complicated issues involving the robot’s not being able to crawl the site or figure out what your pages are all about.
Search Engine Robots – How They Work, What They Do (Part I)
Automated search engine robots, sometimes called “spiders” or “crawlers”, are the seekers of web pages. How do they work? What is it they really do? Why are they important?