Have it both ways: stay discoverable in search while disallowing AI training https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/