User-agent: * Allow: / Disallow: /admin/ Disallow: /submit Disallow: /submit/thanks # AI training crawlers — uncomment to block, leave allowed by default # User-agent: GPTBot # Disallow: / # User-agent: ClaudeBot # Disallow: / Sitemap: https://toolscout.org/sitemap.xml