What’s the X-Robots-Tag HTTP header? And how to use it? by Yoast https://yoast.com/x-robots-tag/