6

After looking through the top 20 pages of the leader board on the winter bash, if I go to the next page I get this error:

Too many requests. Wait 40 seconds before requesting this resource again.

After the timeout period, I can get through even fewer pages, around page 28, before I get that same error.

Now I'm just looking through the hats to find new secret hats, and then on to the next page. Why am I encountering this error?

  • 6
    "Why am I encountering this error?" - Practically everything on SO is rate-limited. – Josh Crozier Dec 20 '15 at 0:03
  • sure, but just browsing through the pages, I can hit it? – David Dec 20 '15 at 0:04
16

Yep. We recently added a rate limit on those pages because several scrapers were hammering them. (I assume they also were looking for secret hats.) I'm sorry for the inconvenience, but we've learned the hard way to rate limit everything. Failing to do that tends to bite us at some point.

As in years past, secret hats are fairly quickly noticed and posted to meta. That's what I'd watch if I were you.

  • It was me, I'm sorry. Apparently I've chosen not the best way to collect hats stats. (not sure if anybody else also did this, it's actually pretty stupid) – nicael Dec 20 '15 at 9:28
  • Thanks for taking care of the site(s) so that we all can still get to it. And @nicael, don't feel too bad. We've all done something like that at one point or another. – Edward Dec 20 '15 at 16:46
  • How would constantly scraping those sites help find new hats? You still wouldn't know how they were collected for secret hats, wouldn't you? – Nit Dec 21 '15 at 21:43

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .