Sometimes I see a question that has been downvoted and I don't agree with the downvote at all (for example if a comment that explains the downvote shows a misunderstanding of the question, or if I think it's an interesting question that I'd like to hear the answer to), but I don't think the question deserves an upvote either. Sometimes I upvote it just to get it back to zero score.
Is this the wrong behavior? I wonder if I'm doing harm by "hiding" the fact that someone has downvoted a question.