In order to understand my question better, consider the following scenario
OP asks a question, makes it clear specifically what he/she is looking for. Gets say 5 answers, 4 of them were irrelevant and asked him/her to compromise on requirements. One is exactly what he is looking for, and is complete with detailed information.
The person who submitted the correct answer gets accepted, but that person also commented on other answers telling them that OP was looking for something different.
Now those other answer-ers get defensive and gang up on that person, and downvote the answer submitted by him (and accepted by the asker). They also invite their troll friends to join the force in downvoting, and the accepted answer becomes a -10.
Now, the person who submitted the accepted answer could take those downvote with a grain of salt; but for future readers who are looking for exact same thing when they land on that question's page will not bother reading the accepted answer (most of them if not all of them) because it has been downvoted too much.
What would be the best way to prevent the above scenario? One way I could think of is, we edit the accepted answer; add bold NOTE on top stating that users should not bother the downvotes, this answer works.
Question is complete. Here are a few more variables that were not provided.
Answer-er had commented to those users asking about their objections. Only one of the downvoter responded and nitpicked the answer asking the solution to be utopial. Answer-er to which complied; but that one person would still not take off his downvote.
In future, people might find it helpful and upvote it, but most people won't bother reading it. I and a lot of my friends tend to jump to the highest rated answer.