This feature would be cool, because I'm sure most of you know the feeling, when you just think someone should shut up, even if they weren't breaking rules.
To avoid awkward situations described here I have a slighly different solution than the questioner:
Problem users should just be blocked from questions of the ignorers, so there won't be any good answers missed because they simply can't answer to the question. In all questions from different users the Ignorers will se the problem users, but this isn't that much a problem, because one can just avoid an annoying user, which isn't the case on your own question.
