What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 133 Stack Exchange communities.

I tried to dump the content of www.stackoverflow.com using Lynx, but I got the following output.

# lynx -dump www.stackoverflow.com

We're sorry...

This IP is only allowed to access our API.

To protect our users, we can't process requests from this IP address.

If you believe you have reached this page in error, [1]contact us.

References

 1. mailto:team@stackoverflow.com

Why is the content restricted? It is an open site and should be accessible by Lynx.
Do I need to do something else to fetch the content with Lynx?
What's wrong with my IP? I am using Amazon EC2 instance.

share|improve this question

migrated from superuser.com Dec 31 '11 at 0:00

This question came from our site for computer enthusiasts and power users.

2  
If you want to view it in Lynx, there is a Lynx version of the SE sites avaliable at column80.com –  Mark Henderson Dec 31 '11 at 1:33

2 Answers 2

up vote 11 down vote accepted

You commented:

i am using Amazon EC2 instance

Requests from Amazon's cloud services seem to be blocked wholesale:

Amazon cloud services are blocked from accessing anything but the API due to a good deal of abuse coming from those services - spammers, scrapers, bots that don't compress their requests and ask for all of our sites causing a good deal of load on our services.

There is probably nothing you can do, short of proxying your requests, or using a different server.

share|improve this answer
2  
...or using the API like the page suggests. Lots of good stuff here for doing that. –  uɐɯsO uɐɥʇɐN Dec 31 '11 at 3:53

The website is accessible by Lynx. It is not accessible from your IP address, like the error message says.

We're sorry...

This IP is only allowed to access our API.

To protect our users, we can't process requests from this IP address.

If you believe you have reached this page in error, [1]contact us.

share|improve this answer
    
hmm i am using Amazon EC2 instance, it should be accessible i believe. –  P K Dec 31 '11 at 0:02
10  
@Praveen IP addresses from Amazon EC2 instances are intentionally blocked due to abuse. –  Tim Stone Dec 31 '11 at 0:05

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .