Results 1 to 3 of 3
  1. #1
    New Pligger aviator's Avatar
    Joined
    Mar 2008
    Posts
    23
    Thanks
    Received:0
    Given: 0

    Sitemap creator and site crawler

    Check out this tool, very nice in crawling sites and creating sitemaps... GSiteCrawler

    In that regard I have a question about the stories whose links are found to be dead (error 404), what do you do with those?

    When a user clicks "Bury" on a story, what happens to those? I would like to have a way, as the site Admin, to be able to find those stories easily to decide wether to discard or keep them.

  2. #2
    Banned bbrian017's Avatar
    Joined
    Oct 2007
    Posts
    784
    Thanks
    Received:0
    Given: 0
    hey thanks for that gsite link I read some of it and will try when I get home!

  3. #3
    Pligg Donor graphicsguru's Avatar
    Joined
    Aug 2006
    Posts
    399
    Thanks
    Received:1
    Given: 0
    This will help with most all your (error 404)
    http://forums.pligg.com/pligg-mods/1...d-stories.html

Similar Threads

  1. Image crawler
    By cenk in forum Questions & Comments
    Replies: 3
    Last Post: 09-16-2009, 01:25 PM
  2. Digg crawler module
    By serjstarling in forum Questions & Comments
    Replies: 1
    Last Post: 06-17-2009, 02:58 AM
  3. PatchLog's sitemap doesn't work on my site!
    By gnalkit in forum Questions & Comments
    Replies: 1
    Last Post: 01-14-2009, 06:39 PM
  4. Google ban for crawler for robot.txt
    By chat2fanna in forum Questions & Comments
    Replies: 2
    Last Post: 06-14-2008, 07:09 PM
  5. Problem with RSS-feed's dc:creator field. Just one fix please!
    By Andtony in forum Questions & Comments
    Replies: 0
    Last Post: 10-15-2007, 12:51 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Pligg Modules and Pligg Templates from Pligg Pro Web Hosting Services by Midphase Dreamhost Web Hosting Donate to Pligg