Possible Duplicate:
Encouraging people to explain down-votesEncouraging people to explain down-votes
I suspect this is happening to me because I there are no comments under my answer.
I think users should only be allowed to down-vote if they leave a comment as to why.