It seems to me that the time travel feature has to be deactivated on a per-site basis. I've tried this in Edge and Chrome.
Is this intentional? It's fine for people using one or two sites, but gives a poor experience if you are using a lot of sites, or just browsing through Hot Network Questions.
Even if I go to a site's meta site from its main site, I find I have to disable it again.