This seems to occur on all Stack Exchange sites and I'm not going to provide any specific examples as that is basically naming and shaming. However, as many of you who work the review queues know, and maybe even some people who submit content to the review queues to be reviewed; the quality and consistency of some reviewers is substandard.
Some general examples:
- Edits that improve posts being rejected as "an attempt to reply to the post"
- Reviewers that have approved 100% of all suggested edits they've ever reviewed, even when others have tried to reject them (ie: they just keep clicking Accept for everything)
- Reviewers who click "No Action Required" for spam and off topic posts
Is there anything that could be implemented so that even established users get audited every now and again, with punishments for failing the audit being remembered and escalating if they keep failing future audits (up to and including perhaps revoking the privilege to work that queue)?
This isn't about one off mistakes, this is about the people who see the review queues as another source of badges and consistently apply the same action to everything just to increase a number and move a progress bar.
I feel that letting this continue as it is results in the duplication of effort on the part of the reviewers who actually pay attention when working through the queues by approving changes that shouldn't be approved, by ignoring content that needs fixing, and allowing more negative posts like spam slip through the net and stick around for longer than it had to.
Can we do something to reduce the amount of poor quality reviewers there are working the queues?