Block AI Crawlers

This plugin will tell AI crawlers not to use your site for their training data. AI crawlers read a site’s robots.txt to check for a request not to index. This plugin will send that signal to AI crawlers.

It asks the following crawlers not to index your site:

• ChatGPT and GPTBot – Crawlers and web browser used by OpenAI
• Google Extended – Crawler used for Google’s Gemini (formerly Google Bard) AI training
• FacebookBot – Crawler used for Facebook’s AI training
• CommonCrawl – Crawler that compiles datasets used to train AI models
• Anthropic AI – Crawler used by Anthropic
• Omgili – Crawler used by Omgili for AI training
• Bytespider – Crawler used by TikTolk for AI training
• Cohere – Crawler used by Cohere AI training
• DiffBot – Crawler used by Diffbot for AI training

Experimental Meta Tags

The plugin adds the “noai, noimageai” directive to your site’s meta tags. These tags tell AI bots not to use your content as part of their data sets. These are experimental and they have not been standardized.

Disclaimer

Note: While the plugin adds these markers, it is up to the crawlers themeselves to honor these requests.