My website follows robots.txt, and only has at most one connection to a host at one time. It never fetches a page more than once an hour. Well within reason (I hope), so I'm wondering why I'm banned and how to resolve it?
Many users of my service have asked to graph their Stack Overflow numbers.
The crawler's IP address: 18.104.22.168
The crawler's DNS: webnumbr.com
And an example of me trying to fetch an Stack Overflow page (30-second timeout) http://webnumbr.com/create?url=https://stackoverflow.com/users/90025/paul-tarjan