# Block problem bots User-agent: Baiduspider User-agent: 360Spider User-agent: Yisouspider User-agent: PetalBot User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / # Block OpenAI User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / # Block Google Bard AI User-agent: Google-Extended Disallow: / # Block Common Crawl AI scraper User-agent: CCBot Disallow: / # Block Perplexity AI User-agent: PerplexityBot Disallow: / # Block other misc AI scrapers User-agent: anthropic-ai Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: claudebot Disallow: /