During today's maintenance, I've noticed an annoying side effect to certain error pages. I happened to end up on https://workplace.stackexchange.com/error?aspxerrorpath=/ when trying to navigate to The Workplace. An interesting side effect of that error scheme is that if you refresh that page, even after the error no longer occurs, you'll continue getting the error page, as if the site was still down. It's because the error redirects you to a URL that will always show you the error.
Since it's an ASPX error, not a "normal" error like the 404 pages, I'm not sure it can be changed, but ideally if you hit an error page you shouldn't be "stuck" on that error page. The error was fleeting, but the error URL scheme isn't.