User-agent: * # DISALLOW CRAWLERS ACCESS TO SPECIFIED DIRECTORIES # Disallow: