My crawler follows Stack's robots.txt directives (it is a general web crawler so hitting many domains). Yet, when I am done crawling I frequently get blocked from accessing your website from a browser for a period of time. I would rather not be blocked and am happy to follow a crawl-delay, but none exists in your robots.txt file (see https://stackoverflow.com/robots.txt)
Your "official" guide to rate limiting does not answer how many requests we are allowed: The Complete Rate-Limiting Guide
Sooo, can you please put in a crawl-delay for your robots.txt file? I understand you may want to be a bit opaque about how many requests people are allowed but for the robots.txt file you could be conservative: e.g. if the "real" limit is 1 request every 5 seconds you could put a crawl-delay of 10 seconds, or 7 seconds, etc.