As mentioned on uservoice:
For something that can be done so easily by accident, there should be the ability to undo mistakes.
I know that I have clicked several times on a comment up-vote without actually wanting to.
I would suggest being able to cancel the up-vote (maybe only for a couple of minutes or even less than a minute, no problem, as long as I can undo a miss-click).