@dansup you can prevent mass crawling without affecting regular use...

https://social.jsantos.eu/users/jmcs/statuses/110644356123135745