https://also.kottke.org/09/01/the-countrys-new-robotstxt-file