WordPress robots.txt: Best-practice example for SEO by Yoast https://yoast.com/wordpress-robots-txt-example/