# /static/robots.txt User-agent: * Disallow: /batch_status/ Disallow: /editor/ Disallow: /downloads/ Disallow: /api/