WebProWorld Part of WebProNews.com
Page One Link To Us Edit Profile Private Messages Archives FAQ RSS Feeds  
 

Go Back   WebProWorld > Search Engines > Google Discussion Forum
Subscribe to the Newsletter FREE!


Register FAQ Members List Calendar Arcade Chatbox Mark Forums Read

Google Discussion Forum Google Discussion forum is for topics specifically related to Google. There is a subforum dedicated to AdSense/AdWords subjects.

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 11-11-2004, 10:07 AM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default has Google got the right to display my w

Why has Google or any other SE got the right to display my website on its search engine? does it own the web?

if I took someone elses content or title and keywords and put the information on my site i'd be in trouble, so why can google or other SE's?

regards

thecat
Reply With Quote
  #2 (permalink)  
Old 11-11-2004, 12:59 PM
WebProWorld New Member
 

Join Date: May 2004
Location: Tampa, FL
Posts: 22
DPAGuy RepRank 0
Default

Hi Cat,

If you do not want your site listed in search engines, you need to add a robot text to you site instructing robots not to index your site.

In addition add a meta tag to each of your pages telling the robots the same thing (nothing like safety by doubling the command.)

If you're not sure how to do this, simply do a search on google for:

"Robot Text Files"
and
"No Index Meta Tag"

Both searches will yield you the information you need to set your site up to not be found via search engines courtesy of sites that do want to be found by people in need of there information, products and services.

Regards
__________________
The greatest gift you can give, is the gift of hope.
support@downpaymentsolutions.com
Reply With Quote
  #3 (permalink)  
Old 11-11-2004, 01:11 PM
WebProWorld Pro
 

Join Date: Nov 2004
Posts: 144
Sanjo RepRank 0
Default

Do you mean their cache of your website or the fact that they list it on their search results?
Reply With Quote
  #4 (permalink)  
Old 11-11-2004, 01:24 PM
WebProWorld 1,000+ Club
 

Join Date: Dec 2003
Location: Houston
Posts: 5,715
greeneagle RepRank 0
Default

Why would you publish media into a public domain and not want anyone to read it (or at least the SE's to find it)?

Why would you publish it without the safeguards mentioned if you didn't want anyone to find it?

If it were a private family Site or something like that, then password it too (that's #3). Use the suggestions above and then #4; Certified Secure Site -Don't understand what you are complaining about!

Ken
Reply With Quote
  #5 (permalink)  
Old 11-11-2004, 01:51 PM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default do they own the web?

Hi guys and thanks for the replys,

Quote:
Do you mean their cache of your website or the fact that they list it on their search results?
Both!

why can they list a website on their search engine without permission from the website owner?

Quote:
Why would you publish media into a public domain and not want anyone to read it (or at least the SE's to find it)?
If one should choose to put a website of whatever content on the web, they should be able to do this with out it being listed in the search engines.
Call i an act of FREEDOM!
why should webmasters have to put robot text and passwords just because a big giant company like google chooses to list our sites, do they own the web? well i think you know the answer to that one,

Quote:
Don't understand what you are complaining about!
Im not complaining about the fact that the SE's list automatically the web, i just wanted to hear your opinions and i thought this was the forum to get it.

regards

thecat
Reply With Quote
  #6 (permalink)  
Old 11-11-2004, 01:58 PM
WebProWorld 1,000+ Club
 

Join Date: Dec 2003
Location: Houston
Posts: 5,715
greeneagle RepRank 0
Default

Many of us have the right and access to abuse, misuse and not even understand the audience in a "public forum/media"..... Just ask Dan Rather! Whether a "Webmaster" or "Spinmaster", it's still a public forum.

LOL
Ken
Reply With Quote
  #7 (permalink)  
Old 11-11-2004, 02:12 PM
WebProWorld Veteran
 

Join Date: May 2004
Location: Not here..
Posts: 627
pedstersplanet RepRank 0
Default Re: do they own the web?

Quote:
Originally Posted by thecat
why can they list a website on their search engine without permission from the website owner?
Erm, lol, your signature......is that your site? if so why put it there if you dont want SE's to pick it up? :D

Robot text file:
Call it robots.txt, and put:

User-Agent: *
Disallow: /

save & upload it in your root directory......

Bingo......most SE's will will not crawl your site.
__________________
Left WPW to do better things So long
Reply With Quote
  #8 (permalink)  
Old 11-11-2004, 02:58 PM
WebProWorld Member
 

Join Date: Mar 2004
Location: Ms
Posts: 63
C French RepRank 0
Default

The poster is not asking how to exclude robots. His question is basically nit-picking as to why Google has the right to spider & list a site with description and cache. Duplicating his content without his permission.
__________________
Decorating Country Home
Reply With Quote
  #9 (permalink)  
Old 11-11-2004, 05:06 PM
sfowler's Avatar
WebProWorld Veteran
 

Join Date: May 2004
Location: Vienna, Austria
Posts: 967
sfowler RepRank 0
Default

It is simply the default setting, like the telephone book. You have to say if you do NOT want to be listed in the phone book, not say if you DO wish to be listed.
__________________
Simon - Biogas, Rauchgasanalysator and Rauchgasanalysegerät
Reply With Quote
  #10 (permalink)  
Old 11-11-2004, 05:22 PM
WebProWorld Veteran
 

Join Date: May 2004
Location: Not here..
Posts: 627
pedstersplanet RepRank 0
Default

Quote:
Originally Posted by Charles French
The poster is not asking how to exclude robots. His question is basically nit-picking as to why Google has the right to spider & list a site with description and cache. Duplicating his content with his permission.
Ok then....Internet = Open Source....... If you dont want information displayed publicly, dont publish it..
Google is a SE, so spidering is their backbone.
__________________
Left WPW to do better things So long
Reply With Quote
  #11 (permalink)  
Old 11-11-2004, 05:35 PM
cbp cbp is offline
WebProWorld 1,000+ Club
 

Join Date: Oct 2003
Posts: 4,987
cbp RepRank 1
Default

Quote:
Why has Google or any other SE got the right to display my website on its search engine?
Because they can :-)

As said above, you can opt out if you don't want thm to.

CBP
Reply With Quote
  #12 (permalink)  
Old 11-11-2004, 06:46 PM
WebProWorld Veteran
 

Join Date: Jun 2004
Location: Indiana
Posts: 484
google junky RepRank 0
Default

Quote:
Originally Posted by sfowler
It is simply the default setting, like the telephone book. You have to say if you do NOT want to be listed in the phone book, not say if you DO wish to be listed.
Congrats sfowler,

That was a perfect example of what we already have in our life that is exactly the same. It's just part of life. The fact that you do have an option should be good enough.

To thecat:
You had that option from the beginning when the code for your site was first published to the web. Just as the phone book comparison that sfowler brought up. I was glad to see you bring something like this up. I had never actually thought of it being like the phone book idea. I now walk away enlightened. :)
Reply With Quote
  #13 (permalink)  
Old 11-11-2004, 09:25 PM
WebProWorld 1,000+ Club
 

Join Date: Dec 2003
Location: Houston
Posts: 5,715
greeneagle RepRank 0
Default

All digital circuits, all the way through and including public media have switches to set! It's just a genetic "deal" with that breed of dog/electronics/life!

If they short circuit or don't exist in the "circuit", (after the Engineer is slapped) the FCC or an individual entity out of a host of organizations, even including powerful pseudo-orgs like the W3C, has you in their sites. That's just the way the game is played!

"Smile, it's all good" (no I am not from Lousiana)

Ken
Reply With Quote
  #14 (permalink)  
Old 11-11-2004, 09:46 PM
WebProWorld Member
 

Join Date: Aug 2004
Location: United Kingdom
Posts: 62
PikoTech RepRank 0
Default

Very interesting discussion when you think about it.

Google labs actually have on their terms and conditions page that "You also agree that you will not use any robot, spider, other automated device, or manual process to monitor or copy any content from the Site." (http://labs.google.com/labsterms.html)

Yet although they do have a robots.txt file for labs.google.com Yahoo! do have the Google labs website in their index. And I'm doubting very much that they wrote to Google to get written permission to add it to their index.

Does that mean Yahoo! should be prosecuted by Google?
Also does that mean Yahoo! ignores robots.txt

Just interesting thoughts :)
Reply With Quote
  #15 (permalink)  
Old 11-12-2004, 04:55 AM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default THINK ABOUT IT!

some very funny replys,

Quote:
Because they can :-) ,cbp
good answer,

pedstersplanet please READ the question, its not about any of my sites. lol is that your site? ..tut

.--------------------(


Quote:
Does that mean Yahoo! should be prosecuted by Google?
thats what im talking about!

or

Does that mean Google! should be prosecuted by me?




Quote:
Very interesting discussion when you think about it.

THINK ABOUT IT! really the bottom line is they havnt got permission, unless the US government has given them the speacial right, then what if they have?
theres not just .COM's on the web!

regards

thecat
(please dont ban me MOD)
Reply With Quote
  #16 (permalink)  
Old 11-12-2004, 05:01 AM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default

Quote:
sfowler wrote:
It is simply the default setting, like the telephone book. You have to say if you do NOT want to be listed in the phone book, not say if you DO wish to be listed.
but a telephone doesnt change the results every day
and I think Im right in saying that the telephone book is run by the Government.

cheers
thecat
Reply With Quote
  #17 (permalink)  
Old 11-12-2004, 05:02 AM
WebProWorld Member
 

Join Date: Aug 2004
Location: United Kingdom
Posts: 62
PikoTech RepRank 0
Default

thecat,

Not quite the same. Inside Google's terms and conditions it specifies bots should not be allowed to collect information from their Google Labs website AND they have a robots.txt file which disallows it (even if Yahoo! does seem to ignore it).

As mentioned previously, if you don't employ a robots.txt file Google is quite likely to index your website. sfowler hit the nail on the head with his analogy.
Reply With Quote
  #18 (permalink)  
Old 11-12-2004, 05:06 AM
WebProWorld Member
 

Join Date: Aug 2004
Location: United Kingdom
Posts: 62
PikoTech RepRank 0
Default

As a further note to the above:

Google will remove your website from their index (and very quickly) if you need to get out as soon as possible.

http://www.google.com/remove.html#exclude_website

The above link will take you to the relevant Google page.
Reply With Quote
  #19 (permalink)  
Old 11-12-2004, 09:52 AM
minstrel's Avatar
WebProWorld 1,000+ Club
 

Join Date: Jul 2003
Location: Ottawa, Canada
Posts: 3,620
minstrel RepRank 0
Default

Honestly, of all the complaints about Google or any other search engine I have ever seen, this must be the silliest.
Reply With Quote
  #20 (permalink)  
Old 11-12-2004, 11:00 AM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default

please understand i am not complaining,,,,sigh sigh,,

all i wanted to know is if google had the legal right to use other peoples content without the website owners permission. Or what is the legal situation.

not about robots/complaints or phonebooks,
sorry the phone book was a good point. thanks fowler.

perhaps somebody might answer the question yet.

Quote:
Honestly, of all the complaints about Google or any other search engine I have ever seen, this must be the silliest.
lol that must be the silliest answer i have ever seen.
sigh

thecat
Reply With Quote
  #21 (permalink)  
Old 11-12-2004, 11:20 AM
minstrel's Avatar
WebProWorld 1,000+ Club
 

Join Date: Jul 2003
Location: Ottawa, Canada
Posts: 3,620
minstrel RepRank 0
Default

All right. If the question is simply, "do they have the legal right?", the answer is "yes".
Reply With Quote
  #22 (permalink)  
Old 11-12-2004, 11:34 AM
WebProWorld Member
 

Join Date: Nov 2004
Location: here and there
Posts: 57
thecat RepRank 0
Default

sorry minstrel, didnt mean to be rude.

So if they have the right to publish other peoples content, then can we?

regards

thecat
Reply With Quote
  #23 (permalink)  
Old 11-12-2004, 11:51 AM
minstrel's Avatar
WebProWorld 1,000+ Club
 

Join Date: Jul 2003
Location: Ottawa, Canada
Posts: 3,620
minstrel RepRank 0
Default

No, not unless you are a search engine, which by the way gives a full and complete reference to the source as well as preserving (most) of the design features and declaring clearly that it is a cache and not the original page.

The internet did not develop as a private domain -- This is not like your personal file cabinet or desk, where you (at least in your home) have a right to expect privacy. It's more like a letter to the editor of a newspaper or a post on a forum or an appearance on a radio or TV program where presumably a lot of other people will view it. If you write a personal letter to the editor of a newspaper that you do NOT want published, I would suggest that you cearly indicate that fact in the letter.

In the case of the internet, there are clear and quite easy ways to prevent search engines from indexing your pages or images. If you choose not to avail yourself of those options, they are and will continue to be published. If you want them to have restricted publication only, use an intranet or a limited print medium.

I don't mean to be insulting to you personally, either, but I still think it's a silly question. To me, it's like standing on a soap box in Hyde Park giving a speech and then suddenly spotting someone listening and saying, "Hey! What do you think you're doing? Who said you could listen to this?".
Reply With Quote
  #24 (permalink)  
Old 11-12-2004, 11:51 AM
WebProWorld Veteran