HTML In Splash Page to Prevent Webots/Crawlers Secuirty HOLE

[telecomworx]

1. Do a web search e.g. (www.dogpile.com) on the term: NBX NetSet
2. Now pick out ALL the pages that show something like this: NBX NetSet
Version: RX_X_Xx Created: Xxx xx XXXX,

Now, you've been successful in finding user companies that assign an public IP address to their corporate telephone systems. Besides being a really dumb thing to do- assigning a public IP to their system- the manufacturer isn't too bright either.

Isn't there some simple html that could prevent the page you see (NBX NetSet splash page) from being indexed by the so called Webots or Webcrawlers ? I know the obvious answer is not to assign a public IP to the box and put the box behind a firewall- which the user/customers will open up port 80/html traffic to the box...so wouldn't the Webots/Webcrawlers still index the page ?

What do you think ?

thank you

[flood6]

There are two common ways to prevent spiders from indexing your data, excluding them with robots.txt and excluding them with meta data. Both methods are described here.

For bots that misbehave by disregarding robots.txt and the meta instructions, you can try this method to trap them and automatically ban them.

I hope that was what you were asking...

Good luck.

[USALUG]

 <meta name="robot" content="noindex,follow">

of course it only works for the "nice" bots. :)

[telecomworx]

Yes you both have been helpful- thank YOU.

I will pass along.