robots.txt  

Results 1 to 2 of 2

Thread: robots.txt

  1. 12-12-2006, 04:37 AM #1
    GoogleBot
    GoogleBot is offline
    Casual Pligger GoogleBot's Avatar
    Joined
    Nov 2006
    Posts
    63

    robots.txt

    Anybody knows how to configure robots.txt? I meant a list of allowed and disallowed files and folders.
    Reply With Quote Reply With Quote
  2. 12-12-2006, 05:20 PM #2
    aixelsyd
    aixelsyd is offline
    Casual Pligger aixelsyd's Avatar
    Joined
    Oct 2006
    Posts
    32
    I would google on robots.txt and howto - there are lots of examples out there.

    One is: http://www.javascriptkit.com/howto/robots.shtml
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Similar Threads

  1. robots.txt 404 Help me
    By moktar in forum Questions & Comments
    Replies: 0
    Last Post: 12-26-2011, 07:20 AM
  2. robots.txt
    By bubu333 in forum Questions & Comments
    Replies: 4
    Last Post: 12-17-2009, 04:04 PM
  3. robots.txt restricting search.php
    By yuval613 in forum Questions & Comments
    Replies: 1
    Last Post: 06-08-2008, 01:42 AM
  4. Questions about robots.txt and sitemaps
    By juanmartinbravo in forum Questions & Comments
    Replies: 5
    Last Post: 01-10-2008, 04:03 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules

Pligg Modules and Pligg Templates from Pligg Pro Donate to Pligg CMS Dreamhost Web Hosting Host Gator Web Hosting