This post targets infrequent unreasonable down-votes that are received after a critical comment of you or a down-vote that you explicitly said it's yours, only.
To be honest, it goes on my nerves if someone down-votes my questions / answers with no reason even more when it is posted within a rare tag that doesn't have much audience to recompense it.
Sometimes I suspect some people since for example I posted a critical comment under their answer, but I'm not sure. However there is a benefit if I know who is the down-voter, that is, I won't participate on their posts anymore in anyway and will be able to mention them while flagging a post of mine with pointing to days I received such irrelevant down-votes.
Their behavior will be destructive. They will down-vote you whenever they receive one, which they think nobody could be in charge of it except you. They think about you. Unfortunately, most of them are aware of serial down-voting consequences hence do their evil votes irregularly to seem legit.
So my question is how can I find if an account that I'm suspicious to, is one who cast a down-vote?