# Robots.txt for Cocolico news site User-agent: * Allow: / Disallow: /info.txt # Only Alexa crawler User-agent: ia_archiver Disallow: