https://howtonotcode.com/story/366-gptbot-crawl-spikes-often-trace-to-robotstxt-not-being-served