Your voting pattern is bad.
First, why did you upvote the question? Was it clear, did it show enough research effort? Was it an interesting question? If so, your upvote was okay. But if it wasn't all that, why did you upvote? It seems quite an obvious answer to me, and maybe the question wasn't that good.
So you decided to upvote the question, that is your assessment, which is fine. Why do you need to retract that vote once OP commented? Was the question suddenly not useful any more? Or was it to punish OP? In that case, your voting is really bad and the community should be lucky the vote was locked.
If you don't like OP for the comment (which is totally okay in my opinion), just leave the discussion. Keep your answer for future readers who do think your post is helpful and they will eventually 'correct' the 'issue'.