iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Go Back   WebProWorld > Search Engines > Search Engine Optimization Forum
Looking for meta tag spidering tool
Index Link To US Private Messages Archive FAQ RSS
Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 04-03-2007, 02:23 PM
WebProWorld Member
  
Join Date: Mar 2005
Location: Florida
Posts: 80
rjjj111 RepRank 1
Default Looking for meta tag spidering tool
I am looking for a free tool, where I can type in my domain name and the tool will spider all web pages on that domain.

I have seen several were you have to type in each page name, that is fine if you have a small website. I would like for the tool to spider all the pages it finds itself.

Any help? thanks.......
Reply With Quote
  #2 (permalink)  
Old 04-03-2007, 03:04 PM
bj's Avatar
bj bj is offline
WebProWorld 1,000+ Club
  
Join Date: Apr 2005
Location: Delaware Valley, PA
Posts: 1,172
bj RepRank 3bj RepRank 3
Default
The google sitemap generator tools do this. And they make a sitemap for you while they do it.
Reply With Quote
  #3 (permalink)  
Old 04-03-2007, 03:17 PM
WebProWorld Member
  
Join Date: Mar 2005
Location: Florida
Posts: 80
rjjj111 RepRank 1
Default
Looks like i have to download a program, do some configuring, plus i have never used the tool. there must be something easier and better out there? right?
Reply With Quote
  #5 (permalink)  
Old 04-03-2007, 06:09 PM
WebProWorld Member
  
Join Date: Apr 2007
Location: Delaware
Posts: 38
seomagnet RepRank 0
Default
You mention in the subject about a meta tag spidering tool but are you actually looking for a sitemap creator?

For sitemaps, this is a good webtool.
http://www.xml-sitemaps.com/

Chris
Reply With Quote
  #6 (permalink)  
Old 04-03-2007, 06:13 PM
WebProWorld Member
  
Join Date: Mar 2005
Location: Florida
Posts: 80
rjjj111 RepRank 1
Default
I am just looking for a meta tag spidering tool, NOT a site map builder.

Thanks.........
Reply With Quote
  #7 (permalink)  
Old 04-03-2007, 06:36 PM
incrediblehelp's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
  
Join Date: Jan 2004
Location: Live in Cincy Now
Posts: 7,573
incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4
Default
How about this?

http://www.webextractor.com/
Reply With Quote
  #8 (permalink)  
Old 04-03-2007, 06:55 PM
WebProWorld Member
  
Join Date: Mar 2005
Location: Florida
Posts: 80
rjjj111 RepRank 1
Default
that one cost $99.00, i would to find a free one if i could.
Reply With Quote
  #9 (permalink)  
Old 04-03-2007, 06:59 PM
incrediblehelp's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
  
Join Date: Jan 2004
Location: Live in Cincy Now
Posts: 7,573
incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4
Default
Have you tried looking on Google yourself?
Reply With Quote
  #10 (permalink)  
Old 04-03-2007, 07:27 PM
WebProWorld Member
  
Join Date: Apr 2007
Location: Delaware
Posts: 38
seomagnet RepRank 0
Default
Hello,

Can you run PHP? Modify to write your own...

Code:
<?php

/**
 * Function to read meta information from the given domain.
 *
 * @param string $domain
 */
function getSiteMeta($domain){
  // Read META info
  $tags = get_meta_tags($domain);

  // Check the result and display it.
  if (sizeof($tags) == 0){
    echo '<tr><td>No META information was found!</td></tr>';
  }
    
  foreach ($tags as $key=>$value) {
    echo "<tr><td>$key: </td><td>$value</td></tr>";
  }

}

?>

<html>
<body>
   <form action="<?php echo $_SERVER['PHP_SELF']; ?>" method="post" name="domain">
     <table>
       <tr><td>Site URL: <input name="domainname" type="text"/></td></tr>
       <tr><td><input type="submit" name="submitBtn" value="Get META" /></td></tr>
     </table>  
   </form>
<?php    
  if (isset($_POST['submitBtn'])){

      $domainbase = isset($_POST['domainname']) ? $_POST['domainname'] : '' ;
      $domainbase = str_replace("http://","",strtolower($domainbase));

      echo '<table width="100%">';
    getSiteMeta("http://".$domainbase);
    echo '</table>';
  }
?>
</body>   
</html>
Reply With Quote
  #11 (permalink)  
Old 04-03-2007, 08:35 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
  
Join Date: Aug 2003
Location: Worldwide
Posts: 8,167
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default
XENU
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

« Advantages / Disadvantages of growing indexability | Help with SEO and a decline in meaningful traffic »
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -4. The time now is 10:59 PM.

WebProWorld - Archive - Top

WebProWorld | Advertise | Contact Us | About | Forum Rules | MVP's | Archive | Newsletter Archive | Top | WebProNews
WebProWorld is an iEntry, Inc. ® site - © 2009 All Rights Reserved Privacy Policy and Legal
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509

Search Engine Optimization by vBSEO 3.3.0