google web crawler

bobkom · #1 (**permalink**) 11-19-2004, 04:58 AM

I have submitted my site http://www.nagarjuna.tk
to google where originally my site is in geocities.
http://www.geocities.com/nagarjuna55334
,I dont know why my internal pages of my site were not crawled by the google,why it happends so, my site search webcrawler all the web pages that are linked to my homepage ,but why the google is not doing that.

sfowler · #2 (**permalink**) 11-19-2004, 05:06 AM

It takes time. If you still have the old copy of your site active, then you will have problems. Duplicate content is penalised. I suggest you either remove teh old Geocities site or mark it NOINDEX for the search engines. Incoming links are the real secret to getting a site crawled and indexed quickly.

bobkom · #3 (**permalink**) 11-28-2004, 12:23 AM

sir, where should i change it as no index

minstrel · #4 (**permalink**) 11-28-2004, 02:36 AM

Place somewhere between the <head> and </head> sections of your pages:

<META name="robots" content="noindex">

pedstersplanet · #5 (**permalink**) 11-28-2004, 05:53 AM

Quote:

Originally Posted by nagarjuna55334

I have submitted my site http://www.nagarjuna.tk

All .tk (well free ones) use a frame for the index page, thus if you put any page name after .tk/my-page.htm (for example), it will still resolve to the index.... I do not know if SE's like this but putting a NOINDEX on the geocities site will only stop your .tk being index seeing as your site is on geocities (i.e. it resolves to your geocities site).
Hope I expained clearly.

bobkom · #6 (**permalink**) 11-28-2004, 06:50 AM

As my page is in geocities.com redirecting url in .tk i can not put either by the .tk/mypage.html
is their another way to google to crawl my all pages in geocities.com

pedstersplanet · #7 (**permalink**) 11-28-2004, 09:17 AM

Quote:

Originally Posted by nagarjuna55334

As my page is in geocities.com redirecting url in .tk i can not put either by the .tk/mypage.html
is their another way to google to crawl my all pages in geocities.com

cjb.net's redirecting facility does what you require (i.e. pages at the end of the url), as I host a site for a mate with a cjb.net url, but his site is just a hobby...... as I say, I have a .tk domain for a fun site, so I don't know if their paid version lets you do what cjb.net does....

HTH..... or failing all that, just submit, or get IBL to, the geocities url...

braknews · #8 (**permalink**) 11-28-2004, 09:40 AM

There is no way that Google can read what is within the .TK frame. As they do not let you control the NOFRAME area you cannot use that to link to your content.

If you want your site to be indexed then you need to have links directly to your Geocities site.

bobkom · #9 (**permalink**) 12-05-2004, 05:28 AM

By not using the frames the google will crawl my pages is there any possibility .