Searching Google for:

filetype:xml site:stackoverflow.com

gives you as the first result:

Stack Overflow sitemap

But clicking on it stackoverflow.com shows you a "Page Not Found" page. Here is the Google cached version of the file (available in this case on the 3rd May).

Is StackOverflow redirecting me based on the User-Agent header (because I try to load it from a browser)?


Apparently, this comment says that SO is blocking browsers to see the file.

So in this case I would need to know how to spoof a search engine bot. For this I have asked this question

And I have also asked the question on meta stackoverflow.com

Not the answer you're looking for? Browse other questions tagged .