I think using words like "vile" and "hate" (and worse insinuations in comments) is completely over the top. Votes in the vast majority of cases are cast with no malice. Downvotes, as the tooltip shown when you hover over the downvote button says, are used when a user thinks:
This question does not show any research effort; it is unclear or not useful
It's as simple as that. No hate, and no bad intentions.
You should take downvotes as a sign that something in your post needs improving, and try to act on that, with no resentment.
If you're getting a lot of downvotes, there is something wrong with your posts, use that information to improve them. If you're getting a few downvotes here and there on otherwise well received posts then don't take it personally, all it is is made up points on a website.
As for penalties; voting is an integral part of how Stack Exchange sites work, and we want to encourage that, not penalise it.
For further discussion on the topic see (amongst various others):