I sometimes feel that people up/down vote based on the users reputation and I also see a few people saying "it's about knowledge sharing - not reputation". So I suggest allowing people to turn off their reputation.
A user would be able to "turn off" reputation. While in this mode, their rep isn't displayed and their incoming up/down votes are not counted. (If they downvote, this will deduct from their hidden rep).
Permissions and privileges will remain unchanged.
[Personally, I want 200 rep to tone down adverts. After that - I don't care about rep]