Submit Your Article Forum Rules

Results 1 to 7 of 7

Thread: SPIDERING

  1. #1

    SPIDERING

    Hey guys, it's my first time on here, but I gotta say, I've been hackin, crackin, and stackin pages trying to get Google (or yahoo or anyone else) to spider my pages automatically.

    How come someone like GameFaqs, that has scripts generate their pages GETS THOSE PAGES LISTED?

    My site is: WonderdogSoftware.Com (only go if your curious, I get enough bandwidth)... but my question is... I have several links throughout the site that all lead to 'Game Titles' on a specific page (both within the page description, title, AND texts) Why are these pages not individually coming up, but rather the link lists that hold them?

    Just curious how those big guys get all their pages listed and I can only get like 5 or 10.

    Anyways, try entering 'Zelda Wind Walker Walkthrough' into Google and you'll see what I mean.

    Thanks for any suggestions you may have.

    Sincerely

    David J Garfield
    ceo@wonderdogsoftware.com

  2. #2
    Hi DavidGarfield,

    The reason why your pages don't come up is because they are behing a membership/password protected page. Spiders can't get in hence no listing ofr these pages

    Leo

  3. #3

    NOPE

    I have a database and various other methods with a huge bunch of content on various video games that doesn't at all have to be presented through the 'paying member contributors'.

    Any other ideas?

  4. #4
    Senior Member OneMoreBite's Avatar
    Join Date
    Aug 2003
    Posts
    268
    I went and took a look using the search terms you suggested and I found a couple links to your site, both of which took me to a page that required registration. So, I went backwards to the domain itself and did find what I think you are referring to when you say you have pages with content, etc., but the problem appears to be the framesets.

    I looked at the source for the main frame and it doesn't appear to contain any text and/or content that search engines would find appealing, and the content frame likewise. You may have better success if the pages (all pages within the frameset) contained meta tags and content.

    Perhaps just add a navigation bar at the bottom of the interior frame with links to the other parts of the site, i.e. FAQ's etc.

    Kathryn
    Free E-book & Instructions in Using EFT & NLP for Weight Loss
    OneMoreBite-Weightloss.com

  5. #5
    Senior Member sudhani's Avatar
    Join Date
    Aug 2003
    Posts
    379
    Simple:

    You have hidden text on your pages. You are lucky. Google didn't notice it (or) even it did you didn't get heavy penalties.

    Remove the hidden text ... before Google decides to drop you from their index or some of your competetors go and suggest the same to google!!!

  6. #6
    Hi, You might also want to use robot tags to guide the spiders through your site.
    http://www.searchengineworld.com/metatag/robots.htm
    "The Robots META tag is a tag to tell a robot if it is ok to index this page or not."

  7. #7

    THANKS GUYS

    It's been almost a year now since you've helped me with your suggestions. I'd just like to say thanks since all your ideas are working and have paid off.

    Thanks again!

    David Garfield
    ceo@wonderdogsoftware.com

Similar Threads

  1. Spidering
    By t'mack in forum Google Discussion Forum
    Replies: 4
    Last Post: 04-24-2006, 10:47 AM
  2. Spidering my website
    By Bill Bradley in forum Web Programming Discussion Forum
    Replies: 1
    Last Post: 09-01-2005, 08:00 PM
  3. Google Spidering
    By misaw in forum Google Discussion Forum
    Replies: 1
    Last Post: 08-09-2005, 03:01 AM
  4. Mod rewrite & spidering
    By emalrola in forum Google Discussion Forum
    Replies: 2
    Last Post: 06-04-2005, 05:41 AM
  5. Spidering Session IDs
    By incrediblehelp in forum Search Engine Optimization Forum
    Replies: 9
    Last Post: 01-16-2005, 09:53 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •