User-agent: * Disallow: /search Disallow: /bin Disallow: /language Disallow: /yhs Disallow: /aol Disallow: /reviews Disallow: /click User-agent: ADmantX Disallow: / User-agent: AlphaBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Buzzbot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: claritybot Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Diffbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: huggingface Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: img2dataset Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Meltwater Disallow: / User-agent: Neevabot Disallow: / User-agent: news-please Disallow: / User-agent: NewsNow Disallow: / User-agent: Nutch Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: http://panscient.com Disallow: / User-agent: Perplexity-ai Disallow: / User-agent: PerplexityBot Disallow: / User-agent: PetalBot Disallow: / User-agent: PiplBot Disallow: / User-agent: http://scoop.it Disallow: / User-agent: Scrapy Disallow: / User-agent: Seekr Disallow: / User-agent: SentiBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: YouBot Disallow: / User-agent: ZumBot Disallow: /