# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: Fasterfox Disallow: / User-agent: ia_archiver Disallow: / User-agent: * Disallow: /track/get Disallow: /mp3 Disallow: /wma Disallow: /download/zip Disallow: /album/comment Disallow: /album/shite Disallow: /album/useful