# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Allow: /index.html Allow: /download.html Allow: /register.html Allow: /feed.rss Allow: /memberfeed.rss Allow: /members/log/527 Disallow: /members/ Disallow: /forum/ Disallow: /mailbox/ Disallow: /logs/ Disallow: /chan/ Disallow: /topic/