I came to Meta because I was wondering whether to report a bug on the voting page: that some candidates have no up/down votable arrows.
So, yes: I
*did* find that confusing/inexplicable; I didn't even notice that the color of their text was relatively faded.
If you want to keep their entry visible then perhaps use
strikethrough: I can barely see the difference between gray and black (that might depend on your monitor's contrast). And showing the voting arrows disabled might be better than not showing them at all.
I also had a warning from my browser (I'm using IE) that a script on that page was running for too long: so I thought that my not seeing voting arrows was maybe an artefact/bug as a result of that (an interrupted script).
Puting a strikethrough through the user's name might be a good, minimal UI (if you like minimal): because that shows that the user's name was deleted from the list of candidates.
Anything except nothing: to show that it's on pupose, and not just an omission, and not just some script accident.