|
Why are you guys using robots.txt to disallow your pages? If you disallow your upcoming page with robots.txt then googlebot won't even hit that page therefore it won't find the story pages that are listed there. The whole point of using robots.txt is to keep the bots away from those files and folders.
|