A bit of a nit-picky thing, I don't think I should be asked to add a comment if I downvote an answer after having just upvoted a comment to that answer.
I already registered my reason for downvoting with the comment upvote, so what you're accidentally encouraging here is a "-1!" or "Me too!"-type comment.
It should be possible to implement this check client-side.