iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Google Discussion Forum Google Discussion forum is for topics specifically related to Google. There is a subforum dedicated to AdSense/AdWords subjects.

Share Thread: & Tags

Share Thread:

Tags
google, media partners, robots

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 11-04-2009, 12:12 PM
WebProWorld Pro
 
Join Date: Oct 2005
Location: Belgium
Posts: 215
Gert Leroy RepRank 0
Default robots.txt Mediapartners-Google question

hi, i made my robots.txt for Dutch Martial Arts .com (which is a wordpress site)

purpose:
Adsense bot has to have access to all pages
Googlebot has some restrictions

Robots.txt:

User-agent: Mediapartners-Google*
Disallow:

User-agent: *

# disallow all files with ? in url
Disallow: /*?*

Disallow: /wp-content/themes/church_30_dutchmartialarts/
Disallow: /feed/
Disallow: /comments/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /tag/
Disallow: /author/
Disallow: /cat/

seems pretty understandable..
however, when i do the test in Google webmasters tools, they say me the pages that are blocked for googlebot, are also blocked for the adsense bot. What is wrong with the robots.txt?

e.g. DMA nieuws & promoties | DutchMartialArts.com is also blocked for the adsense bot..
Reply With Quote
  #2 (permalink)  
Old 11-04-2009, 02:10 PM
wige's Avatar
Moderator
WebProWorld Moderator
 
Join Date: Jun 2006
Location: United States
Posts: 2,661
wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9
Default Re: robots.txt Mediapartners-Google question

Try without the asterisk after Mediapartners-Google. As I recall, you can't have an asterisk there.
__________________
The best way to learn anything, is to question everything.

Last edited by wige; 11-04-2009 at 02:13 PM.
Reply With Quote
  #3 (permalink)  
Old 11-13-2009, 10:28 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,170
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default Re: robots.txt Mediapartners-Google question

Quote:
Originally Posted by wige View Post
Try without the asterisk after Mediapartners-Google. As I recall, you can't have an asterisk there.
Yes Wige. I can confirm that you are right.
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
Reply

  WebProWorld > Search Engines > Google Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
One click on a link generates 3 opening 2 by Mediapartners-Google ? Corobori Web Programming Discussion Forum 1 06-22-2009 10:13 PM
Robots.txt Question? jimmy03 Search Engine Optimization Forum 9 05-19-2009 06:43 AM
Mediapartners-Google/2.1 ?? what's that? sandis.viksna Google Discussion Forum 1 10-27-2004 09:13 AM
Robots.txt question dyno Google Discussion Forum 2 08-24-2004 11:13 PM
A Robots.txt question braknews Google Discussion Forum 3 08-20-2004 03:31 PM


All times are GMT -4. The time now is 08:01 PM.



Search Engine Optimization by vBSEO 3.3.0