[identikit]

Hi all
I cannot figure out how to set discarded story noindex, nofollow

I have been trying on pligg.tpl and meta.tpl
{if $story_status eq "discard"}
<meta name="robots" content="noindex,nofollow" />
{else}
<meta name="robots" content="index,follow" />
{/if}


the problem is that $story_status work only on link_summary.tpl

anybody knows how to turn on $story_status for pligg.tpl or meta.tpl ??

[Yankidank]

Good thinking. I Think we will come up with a solution and apply the changes to the "Wistie" template. Putting this on our to-do list.

[chuckroast]

How would a discarded story get indexed anyway? Once a story is set to discard all links pointing to it are removed so a search engine wouldn't index or crawl it anyway correct?

[identikit]

Originally Posted by chuckroast

How would a discarded story get indexed anyway? Once a story is set to discard all links pointing to it are removed so a search engine wouldn't index or crawl it anyway correct?

thanks Yankidank

the submitter could link to the discarded page and make crawl discovery that page or other search engine that dont follow robots...
better be safe ...

i also puted this on pligg.tpl for canonical link and to close all non existent category

{if $pagename eq 'story'}<link rel="canonical" href="{$my_base_url}{$my_pligg_base}{$navbar_where .link2}" />{/if}
{if $pagename eq 'published'}<link rel="canonical" href="{$my_base_url}{$my_pligg_base}/{$navbar_where.text2}/" />{/if}
{if $pagename eq 'index'}<link rel="canonical" href="{$my_base_url}{$my_pligg_base}/" />{/if}
{if $pagename eq 'story'}
{if $navbar_where.link2 == $login_url|replace:"/login.php?return=":""}
{else}
{php}
header('HTTP/1.1 404 Not Found');
header('Location:' .my_base_url.'/404error.php' );
die();
{/php}
{/if}{/if}
</head>


let say if i have one category called news



http://mydomain.com/news/article-to-show is correct
http://mydomain.com/a/article-to-show is not correct but shows the same story
http://mydomain.com/b/article-to-show is not correct but shows the same story

with the last part redirect all wrong story to 404

[Yankidank]

Chuckroast and I were arguing in IRC over whether or not Google would continue to index a discarded story prior to removing it from your database. My argument is that even though no pages link to it anymore once it is discarded, if a search engine crawled it before the status change it would continue to archive it. Chuckroast believes that once all of the links pointing to the article are gone (after setting it to discard), search engines will quickly remove the content from their archives. Either way, it probably wouldn't hurt to tell search engines not to index it.

Oh wow! Good catch with those alternate category URLs, I never noticed that before. Thanks for the fix, applying it to the SVN.

[chuckroast]

Originally Posted by Yankidank

Chuckroast and I were arguing in IRC over whether or not Google would continue to index a discarded story prior to removing it from your database. My argument is that even though no pages link to it anymore once it is discarded, if a search engine crawled it before the status change it would continue to archive it. Chuckroast believes that once all of the links pointing to the article are gone (after setting it to discard), search engines will quickly remove the content from their archives. Either way, it probably wouldn't hurt to tell search engines not to index it.

Oh wow! Good catch with those alternate category URLs, I never noticed that before.

This is not exactly correct. There was absolutely no argument. We were discussing the pros and cons.
Websites change links all the time. If search engines didn't remove old links that are not being indexed anymore, Google would be filled with 404 error links in their search results.

If you change the title of a story you are essentially changing the url to the story. The next time Google crawls the site and sees that the original no longer exists, it drops it from the index. Yankidank believes that the link and search result in google would still be there. I however know that google will drop that original from the index and only add the new links that it sees durring the crawl. The same would be true of a discarded story.. If it was indexed before it's status had been changed to discard, it would be in the google index. But as soon as you discard it, and the next time google crawls the site, it's not going to see that as a valid url to crawl anymore and remove it from their search results.

The only way this would be an issue is from what Identkit explained above. If someone had linked to the story url from an outside website. However discarded stories are just that, discarded, and should be deleted anyway.

[identikit]

Im trying to think from the SEO Point of view here:
there is still , even if is getting much better, issue with spam.
automatic spam get discarded.
wrong article with no title or unfinished get discarded.
i use Story Moderation Module and those story get a discarded status until you approve it.
It will be nice and make sense to put everything on a no index mode until they are published and will also help fighting spammer

If you change the title of a story you are essentially changing the url to the story. The next time Google crawls the site and sees that the original no longer exists, it drops it from the index

Iit shouldn't be allowed to change title or category by the user after the post has been published to avoid the change of url.

what would be nice is if you could point me how to show that $story_status on pligg or meta because i think there is not reason to show google stories that nobody find it interesting and thats why are still discarded or queue .

[peppolone]

problems:
1) from the admin panel links of stories are like
story.php?title=
so now are all 404
2) now pagination pages has link canonical to index

story canonical: for the seo we have to add the link canonical if we are not in the canonical url
for example if we are on
pligg.com/apple/title_of_the_story/sssss
we can add the canonical to
pligg.com/apple/title_of_the_story/
but if we are on pligg.com/apple/title_of_the_story/ has no sense add the canonical to the same page, so we can remove it, i simplify to

{if $pagename eq 'story'}
{if $navbar_where.link2 neq $login_url|replace:"/login.php?return=":""}
{php}
header('HTTP/1.1 404 Not Found');
header('Location:' .my_base_url.'/404error.php' );
die();
{/php}
{/if}
{/if}

link canonical is good for sort news, for example /year/technology/ and /day/technology/
to /technology/
i hope you can understand my english

[peppolone]

mmm links from twitterfeed now doesn't works
for example
Festa di Mavaffanculp 2010 | 17.09.10@ Birreria Luna Turca, Abazia di Masio( AL ) - Upnews.it
has the ?utm_source=twitterfeed&utm_medium=twitter
i changed mine to
{if $pagename eq 'story'}
{if $navbar_where.link2 neq $login_url|replace:"/login.php?return=":""}
<link rel="canonical" href="{$my_base_url}{$my_pligg_base}{$navbar_where .link2}" />
{/if}
{/if}
in this case the canonical is good
maybe the redirect to 404 if the category of the news is not the same of the url is better from the story.php

[identikit]

Originally Posted by peppolone

mmm links from twitterfeed now doesn't works
for example
Festa di Mavaffanculp 2010 | 17.09.10@ Birreria Luna Turca, Abazia di Masio( AL ) - Upnews.it
has the ?utm_source=twitterfeed&utm_medium=twitter
i changed mine to
{if $pagename eq 'story'}
{if $navbar_where.link2 neq $login_url|replace:"/login.php?return=":""}
<link rel="canonical" href="{$my_base_url}{$my_pligg_base}{$navbar_where .link2}" />
{/if}
{/if}
in this case the canonical is good
maybe the redirect to 404 if the category of the news is not the same of the url is better from the story.php

in fact my idea was to redirect the wrong category to the canonical link.
i have been trying to do that but without luck.
i personaly dont use twitterfeed but i remember that you could remove the "?utm_source=twitterfeed&utm_medium=twitter" from the settings