I got +n reputation, while I was searching a question in the SE search. I clicked the achievements icon to make it disappear, but it didn't:
Clicked achievement dialog:
Clicked out of the dialog to close:
The +2 remains and the green background has disappeared. However, after a reboot it disappears.
Worth noting it happens only on