The inline editor can be closed by hitting Esc - it is quite useful. Please allow it for the inline tag editor.
So, that's quite annoying. Especially because I've hit 10k on MSE and now legally use the inline tag editor there.
There's a simple user script I made for this purposes, it essentially clicks the cancel button if the tag editor is focused.