robots.txt restricting search.php

[yuval613]

Hi

I noticed in my google webmaster tools account that googlebot does not crawl my search page. I noticed that in the robots.txt file the search is under the Disallow. Is there a reason why it's like that? What could be the problem with google indexing my search pages?

[chuckroast]

Hi

I noticed in my google webmaster tools account that googlebot does not crawl my search page. I noticed that in the robots.txt file the search is under the Disallow. Is there a reason why it's like that? What could be the problem with google indexing my search pages?

Hi
Because the search uses the tags and since multiple stories will most likely use the same tag, Google will penalize you for indexing duplicate content..