Questions tagged [review-audits]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

Filter by
Sorted by
Tagged with
352
votes
1answer
11k views

What are review tests (audits) and how do they work?

I recently received this rather amusing message while reviewing a user's first post: Congratulations! This was only a test, designed to make sure you were paying attention. This post has already been ...
403
votes
5answers
6k views

Add an “I don't understand” option for review audits

Background This is somewhat specific to Stack Overflow. My concern is the "I understand" button that appears when you fail a Review Audit. I had this experience twice recently (after never ...
130
votes
1answer
2k views

Bring a “human factor” into review audit composition/selection

Some people are complaining about the automatically generated audits. They are based on close reasons and apparently are a little controversial :-) Failed low-quality review audit Reopen Question ...
120
votes
3answers
1k views

Adding a comment should not make me fail the review audit

I just failed these review audits in First Post, I read the question and thought it seemed reasonable but the user was deleted so to be on the safe side I clicked add comment and I failed the audit. ...
96
votes
5answers
3k views

Why no honeypot suggested edits?

While the review audits are great and much needed, as far as I can tell they do not apply for the suggested edits queue. Robo reviewers can still approve crap and smile all the way to their badges. ...
33
votes
1answer
808 views

Failed a Reopen Question audit — sure looks like “Not a real question” to me [duplicate]

I just failed this audit here, which was shown as being closed as "Not a real question". Seeing as the vote count was positive, I figured it was an audit, but I selected "Leave Closed" anyways ...
65
votes
1answer
1k views

Review-beta: Obviously good answer in low-quality

Today I came across an OBVIOUSLY good answer in /review. It had 7 upvotes, contained lists, paragraphs of explanation, and well-applied sample code. It was also moderately long. How does a question ...
117
votes
3answers
1k views

Close vote review audit flawed - fails without casting vote

Having just failed my first review audit from any of the queues, it was reviewing close votes; however, this audit was flawed in that I didn't even cast a close vote. Often I press the Close button ...
73
votes
6answers
870 views

“Improve” treated as improper response to proper response to audit

For the first time I failed an audit in review, but I sure don't think I should have. I saw the edit wasn't that good, so I hit the improve button to clean things up and got this message: This was ...
80
votes
3answers
2k views

Improving the Quality of Reviews: Project Honeypot

There has been a lot of discussion/complaints about the quality of reviews. Many have noted that a large (maybe even a majority) of reviews are rubber stamps in pursuit of a Steward badge (especially ...
30
votes
1answer
348 views

Audits bug in the filtered review queue

Just recently the audits have been introduced to filtered review queues. I've got an audit this morning which seems to be out of scope for my filtered list. I have filtered my list to only review VBA ...
114
votes
2answers
3k views

“STOP! Look and Listen” audit tricked me

I have noticed this "STOP! Look and Listen" message when the system audits you by having you review something to check how you respond. However, this audit came up and I was tricked. I wanted to up ...
138
votes
6answers
2k views

The time of automatic review bans should be increased with every new ban

The way the current auto-bans for reviews work is rather suboptimal. Somebody who's really after the badges and doesn't care whether they're banned for two days can just continue clicking through, ...
64
votes
1answer
674 views

Too many review audits

I just had 8 review audits in a row without an actual review in the first post review queue on Stack Overflow. Same thing happens in the Late Answers queue and the Low Quality Posts queue. Is this ...
132
votes
3answers
3k views

Why am I getting the message “You've failed too many recent review audits”? [duplicate]

Today I clicked on Review and saw the message below. You've failed too many recent review audits - looks like you might need a break. Come back in in 7 days and try again. Why does this type of ...
208
votes
4answers
2k views

Stop using real accounts in suggested edit audits

Well, thanks for making me harass a user over attempting to vandalize a post! Got a flag on a question notifying us that a new, low-rep user submitted a bogus edit suggestion. Okay, so I went and took ...
31
votes
2answers
683 views

Using the “flag” loophole to pass every review audit

My question pertains to the review audits that occasionally appear when using the "review" feature on Stack Overflow. I know that if you fail too many of these audits, your reviewing privileges can be ...
27
votes
3answers
474 views

Are the suggested edit audits too easy?

Yes, this might be another post complaining about audits. But, in this case, I want the audits to be more difficult. Specifically, I'm concerned that the suggested edits audits are just too darn easy ...
17
votes
2answers
358 views

Is there supposed to be feedback on edit-review audits?

I think I passed an edit-review audit today. I rejected something that was so horrible I was sure it was a honeypot. But nothing happened. I checked in the history and yes, it was an audit. I can't ...
28
votes
1answer
373 views

Post I voted down and close is shown to me as known good audit?

Post that has been presented as a "known good" audit item is one I voted down and close about two weeks ago (close vote expired). Is the algorithm to pick such items designed to allow posts having ...
7
votes
1answer
161 views

Is it possible to see own 'review queue audits' results?

I completed recently a few review audits, some of them I passed, some I failed. Is there a place I could (easily) find these results?
52
votes
0answers
333 views

Moderators should have easy access to a user's complete review history, including audits

We often get questions here on Meta or through other channels about why a particular user was banned from review by the system. Additionally, we frequently want to look into a user's review history ...
32
votes
1answer
251 views

I would like to see my review audit history

Confession: I have been suspended a couple times from reviewing activities. Partial Redemption: I have become better and better at passing audits. I'd like to see my recent and distant history with ...
9
votes
2answers
287 views

Close Vote Review Audits are too obvious

The other day, I got an obviously good question in a Close Vote Review. Even if I didn't read the question, +11 with 3 answers is a bit of a giveaway. Today I got one where the question was almost ...
79
votes
2answers
1k views

Stop bothering me with suggested edit review audits

I have spent considerable time reviewing suggested edits. Less so lately, mainly because of the brokenness around improving, but more and more because those !*#^)(@^&#)@ audits are getting on my ...
20
votes
1answer
574 views

How many failed audits to be put on quarantine?

From time to time I fail a review audit. That's another story, but after not having run in to an audit (and certainly not failing one) for over a week, and suddenly failing one, I got banned from ...
77
votes
3answers
515 views

Give moderators the ability to mark reviews as “bad”

From what I've seen, many SO moderators trawl completed reviews and watch out for robo reviewers; and manual banning them when they see enough (>= 3?) bad reviews. This is inefficient because: It ...
43
votes
1answer
419 views

Add “too minor” audits to Suggested Edits review queue

I've thought about proposing this for a while. It would be very easy to make or curate "too minor" review audits. Chances are, many of them are approved. I don't know how big of a problem it is for ...
34
votes
2answers
582 views

Why does pressing the flag button make you fail an audit?

Few arguments against it: Pressing the flag button doesn't mean actually submitting it (as in every test/form). There might be an unknown duplicate, if you assume it's the first post (as you were ...
13
votes
1answer
583 views

Review ban after skipping a review

So I received the following message today after clicking the 'Skip' button on a close vote review because I guess I took too long to vote on it and it said it was already closed when I tried to vote. ...
42
votes
2answers
245 views

In the review queue, audits should only fail (or pass) you once you actually would take action [duplicate]

I just had a review queue audit question "fail" because I clicked "Close" on a post that the community felt should be left open. This particular meta question is about the close vote review queue, but ...
30
votes
0answers
248 views

Refreshing the page of a suggested edit audit kills the audit

Steps to repro: Find a suggested edit that seems suspicious (clearly an audit) Press F5 OR Ctrl+R OR the refresh button (who uses the GUI anyway) ... Break the audit! (see image) Link to the audit (...
27
votes
5answers
632 views

Incorrect audits [closed]

Today, I failed an (unfair and incorrect) audit, the first one in a while, and I'm now banned from reviewing for two days. I naturally find this unfair and stupid, and I would really like to get the ...
14
votes
1answer
139 views

Typo on the Close Votes review audit failure message

There is a (very minor) typo in the Close Votes review audit failure message. The message is presented as follows: STOP! Look and Listen. This was an audit, designed to see if you were paying ...
-53
votes
3answers
2k views

Bill the Lizard's Closing Antics [closed]

Bill the Lizard is the number 1 reviewer when it comes to Close Votes. Now I can only respect the amount of time he's put in to sealing that podium position, however he's doing this in such a way that ...
20
votes
2answers
608 views

Review Audit failed when “late answer” answer is a duplicate

I just got a review audit where the "late answer" was a duplicate of the accepted answer, but flagging it on that basis failed the review. That seems like a bug to me. Question here: Is it better to ...
10
votes
1answer
210 views

Strange Text After Passing Suggested Edit Audit

Not entirely sure what's happening here but it definitely looks wrong: The message popped up at the same time as the Congratulations message. Our system has identified this edit as possible spam; ...
10
votes
1answer
190 views

How do we select audits for Reopen review?

I occasionally fail audits for the Reopen review queue. My problem is not that I click without any thoughts, but that I honestly don't think the questions should have been reopened (had they been ...
87
votes
2answers
488 views

Give new edit reviewers some audits to begin with

Apparently many new reviewers approve crap that: is just crap 💩 (or spam) introduces backticks to emphasize stuff add typos, chatspeak and other noise. plz help me kind sirs! Giving them some ...
92
votes
2answers
609 views

Showing comments for a question should not fail a “first answer, known to be good” audit

So this audit came up. It was clearly not a crap answer, and I could tell it was probably an audit because no username was being displayed, but I wanted to read the question before deciding whether to ...
10
votes
3answers
357 views

Add a positive feedback for all types of review audits

In my continuing series of posts about review audits, here's what I learnt so far: StackOverflow is not being used to train machine learning algorithms The lack of feedback from successfully passing ...
30
votes
4answers
390 views

Is anyone monitoring people rejecting good edits or approving bad ones?

Right now I can say "good" or "bad" to a proposed edit at my discretion, but is anyone able to see this decision and moderate it? I recently saw a good edit that I was going to approve, but when I ...
23
votes
2answers
383 views

YARAFP: Yet Another Review Audit Failed Post [closed]

I just failed a close-vote audit by voting to close this question. I genuinely believe there is a good case for closing it, as the question has a number of issues. Yes, it has five upvotes, an ...
20
votes
0answers
152 views

Close vote review audit is broken - displays “on hold” while reviewing [duplicate]

I just reviewed this: https://stackoverflow.com/review/close/2385381 But while reviewing, it already displays the "put on hold as not a real question" section, and it asked: Should this question ...
8
votes
1answer
123 views

Review audits with deleted posts [duplicate]

When reviewing, it is possible to edit the post that is presented. However, when what you are reviewing is actually a review audit and you click edit, the following message appears: This post is ...
22
votes
1answer
143 views

A reopen queue review audit shouldn't show me a question that has an active bounty

While processing the reopen queue on Super User I was presented with this: https://superuser.com/review/reopen/88150 I was immediately suspicious as a) the question was quite detailed and b) the ...
21
votes
3answers
536 views

Failed low-quality review audit

I recently came across this answer (to a question on implementing echo cancellation in Java) in the low quality review queue: The only way to supress echo is to use "C" libary of AEC and ...
18
votes
1answer
203 views

Filtered Review Queue doesn't show any audits

In the last 3 days I have only been reviewing a filtered review queue. That's 120 reviews without a single audit.
18
votes
1answer
185 views

'Good' review audits can be misleading [duplicate]

I just failed this review audit. This post looked good; very concise. However given that the question had 5 other answers, I thought the odds of this post being just a repeat of information in another ...
15
votes
2answers
570 views

This post was of very poor quality?

I'm a bit embarrassed to admit this, but I failed the review honeypot at https://stackoverflow.com/review/first-posts/1126342. (The question is at How to create a link text in a table using c#.) I ...

1
2 3 4 5