5

I tried to add an article I wrote to my profile but I receive an error response of: "Sorry, we could not retrieve that URL for some reason."

I have been able to add links from 2 other domains, so I am not sure if there is some issue with the host of this blog post. The link I am using is: https://career.eng.ohio-state.edu/blog/?p=843

1
  • I'm also getting an SSL error on that site, which is also a problem.
    – TRiG
    Dec 3, 2012 at 17:39

1 Answer 1

7

We do a HEAD request to the URL to see what type of content it is, followed by a GET if it’s HTML. In this case, the server is returning a 403 Forbidden on the HEAD request, at which point we stop.

(I also tried doing manual raw HTTP HEAD requests with the same result.)

2
  • 1
    You mean people actually use HEAD requests? May 10, 2012 at 14:21
  • 4
    Heh, yes. In this case, we want to know if it’s HTML before GETting the payload. If it’s not HTML (eg PDF), we don’t want the payload, just the URL. May 10, 2012 at 19:31

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .