Hello,
I have pligg installed on
Esto se sale 2.0 / Portada
This is my my robots.txt file that I uploaded to
http://estosesale.com/news: Quote:
# All robots will spider the domain
User-agent: *
Disallow: /templates/
Disallow: /templates_c/
Disallow: /3rdparty/
Disallow: /libs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /internal/
Disallow: /backup/
Disallow: /thickbox/
Disallow: /api/
Disallow: /evb/
Disallow: /avatars/
Disallow: /admin_index.php
Disallow: /admin
Disallow: /story.php
Disallow: /login.php
Disallow: /user.php
Disallow: /js/
Disallow: /img/
Disallow: /story/
Disallow: /story/title/
#Disallow: /search
#Disallow: /submit
#Disallow: /webalizer
#Disallow: /modlogan
#Disallow: /files
#Disallow: /cache
#Disallow: /faq-en.php
|
(Some of them have
# because I am not sure about if I also should disallow it but I was planning to do it.)
I took it from
Stop Pligg Duplicate Content Hack : SEO Hacks 1. I think that my pligg doesn't have story pages (I mean with the word story on the url) because I'm using urlmethod2. Am I right?
2.I don't want to exclude from google upcoming, but I want to exclude pages as:
estosesale.com/news/upcoming/page/2/
estosesale.com/news/upcoming/page/3/
and
estosesale.com/news/published/page/2/
estosesale.com/news/published/page/3/
Should I add the lines detailed below to my robots.txt file?
Disallow: /upcoming/page/
Disallow: /published/page/
3.IMPORTANT QUESTIONS:
Do you think my robots.txt file will have an effect as good as what is being discussed on this thread? Or should I delete it and follow your instructions? I mean is better to edit the files as Simon explained or the robots.txt will produce same effect.
Hope my regular english has let me explain everything clear...
Thanks in advance,
Juan