26

I've been doing my browsing through a VPN hosted on Amazon.

(Due to increased governmental and recording industry snooping, I'm working on alternatives to traceable IP addresses. I'm not actually doing anything "bad" myself.)

Stack Overflow is blocked and says:

only API requests are accepted from this address

Is there a good reason for this? Especially as I'm using a static (elastic) IP which is tied to my user - it's not like an open proxy.

1
  • 3
    Update .. Stackexchange sites no longer block traffic from AWS :). Commented May 15, 2014 at 3:05

2 Answers 2

37

Amazon cloud services are blocked from accessing anything but the API due to a good deal of abuse coming from those services - spammers, scrapers, bots that don't compress their requests and ask for all of our sites causing a good deal of load on our services.

We may re-visit this at some point in the future, but I doubt the limitation will be lifted.

7
  • 6
    Adding a captcha would be good .. that's how whirlpool.net.au deal with the issue Commented Feb 8, 2013 at 8:04
  • @MandarLimaye, How does a captcha block a scraper (a scraper only reads, and doesn't do any writes at all)?
    – Pacerier
    Commented May 14, 2014 at 15:58
  • @Pacerier All request coming from AWS are directed to a blank page with just the captcha ... once the user solves the captcha they are redirected to the actual content. BTW .. SO sites have stopped blocking AWS requests now. Commented May 15, 2014 at 3:03
  • @MandarLimaye, How do we even know the entire set of IPs belonging to AWS in the first place?
    – Pacerier
    Commented May 18, 2014 at 17:00
  • They publish an updated list here: forums.aws.amazon.com/ann.jspa?annID=1701 Commented May 20, 2014 at 3:26
  • This list has been permanently moved to docs.aws.amazon.com/general/latest/gr/aws-ip-ranges.html (I'm posting this as Amazon stated that they will eventually deprecate their forum post.) Commented Jan 5, 2015 at 23:50
  • from some AWS instances I receive 403 Forbidden when trying to access stackoverflow.com/feeds/tag/android Any ideas why?
    – Rubycon
    Commented Oct 5, 2016 at 15:52
6

I can't find the post where the Team discusses this, but some Amazon properties are blocked because too many people used it to automate scripts to scrape pages and other automated tasks.

A few bad eggs ruin it for everyone.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .