I'm new to Pligg and am installing adsense codes to my site. When poking around in google's support/help articles, I came across this:
If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
User-agent: Mediapartners-Google
Disallow:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.
I went into my robots.txt file and it was reading the user-agent as just *. Any idea whether changing it over to the google-suggested one will make any difference (good or bad)? The site's been up for about two years & has been indexed & found just fine thus far. I don't want to mess with anything that might affect what it already has going for it.
