Skip to main content

Questions tagged [review-audits]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

Filter by
Sorted by
Tagged with
374 votes
1 answer
12k views

What are review tests (audits) and how do they work?

I sometimes receive this rather amusing message while reviewing in the review queues: Congratulations! This was only a test, designed to make sure you were paying attention. You passed. If I am not ...
433 votes
5 answers
6k views

Add an "I don't understand" option for review audits

Background This is somewhat specific to Stack Overflow. My concern is the "I understand" button that appears when you fail a Review Audit. I had this experience twice recently (after never ...
hardmath's user avatar
  • 5,268
137 votes
1 answer
2k views

Bring a "human factor" into review audit composition/selection

Some people are complaining about the automatically generated audits. They are based on close reasons and apparently are a little controversial :-) Failed low-quality review audit Reopen Question ...
Kate Gregory's user avatar
  • 75.1k
124 votes
3 answers
1k views

Adding a comment should not make me fail the review audit

I just failed these review audits in First Post, I read the question and thought it seemed reasonable but the user was deleted so to be on the safe side I clicked add comment and I failed the audit. ...
Aboutblank's user avatar
  • 1,530
98 votes
5 answers
3k views

Why no honeypot suggested edits?

While the review audits are great and much needed, as far as I can tell they do not apply for the suggested edits queue. Robo reviewers can still approve crap and smile all the way to their badges. ...
Shadow Wizard Love Zelda's user avatar
34 votes
1 answer
861 views

Failed a Reopen Question audit — sure looks like "Not a real question" to me [duplicate]

I just failed this audit here, which was shown as being closed as "Not a real question". Seeing as the vote count was positive, I figured it was an audit, but I selected "Leave Closed" anyways ...
LittleBobbyTables - Au Revoir's user avatar
65 votes
1 answer
1k views

Review-beta: Obviously good answer in low-quality

Today I came across an OBVIOUSLY good answer in /review. It had 7 upvotes, contained lists, paragraphs of explanation, and well-applied sample code. It was also moderately long. How does a question ...
Dustin's user avatar
  • 1,963
118 votes
3 answers
2k views

Close vote review audit flawed - fails without casting vote

Having just failed my first review audit from any of the queues, it was reviewing close votes; however, this audit was flawed in that I didn't even cast a close vote. Often I press the Close button ...
Jason Sturges's user avatar
73 votes
6 answers
891 views

"Improve" treated as improper response to proper response to audit

For the first time I failed an audit in review, but I sure don't think I should have. I saw the edit wasn't that good, so I hit the improve button to clean things up and got this message: This was ...
Lance Roberts's user avatar
30 votes
1 answer
364 views

Audits bug in the filtered review queue

Just recently the audits have been introduced to filtered review queues. I've got an audit this morning which seems to be out of scope for my filtered list. I have filtered my list to only review VBA ...
user avatar
117 votes
2 answers
3k views

"STOP! Look and Listen" audit tricked me

I have noticed this "STOP! Look and Listen" message when the system audits you by having you review something to check how you respond. However, this audit came up and I was tricked. I wanted to up ...
Austin Henley's user avatar
80 votes
3 answers
2k views

Improving the Quality of Reviews: Project Honeypot

There has been a lot of discussion/complaints about the quality of reviews. Many have noted that a large (maybe even a majority) of reviews are rubber stamps in pursuit of a Steward badge (especially ...
Ben D's user avatar
  • 2,108
142 votes
6 answers
2k views

The time of automatic review bans should be increased with every new ban

The way the current auto-bans for reviews work is rather suboptimal. Somebody who's really after the badges and doesn't care whether they're banned for two days can just continue clicking through, ...
slhck's user avatar
  • 34.8k
64 votes
1 answer
692 views

Too many review audits

I just had 8 review audits in a row without an actual review in the first post review queue on Stack Overflow. Same thing happens in the Late Answers queue and the Low Quality Posts queue. Is this ...
FDinoff's user avatar
  • 1,207
218 votes
4 answers
2k views

Stop using real accounts in suggested edit audits

Well, thanks for making me harass a user over attempting to vandalize a post! Got a flag on a question notifying us that a new, low-rep user submitted a bogus edit suggestion. Okay, so I went and took ...
user avatar
135 votes
3 answers
3k views

Why am I getting the message "You've failed too many recent review audits"? [duplicate]

Today I clicked on Review and saw the message below. You've failed too many recent review audits - looks like you might need a break. Come back in in 7 days and try again. Why does this type of ...
32 votes
2 answers
716 views

Using the "flag" loophole to pass every review audit

My question pertains to the review audits that occasionally appear when using the "review" feature on Stack Overflow. I know that if you fail too many of these audits, your reviewing privileges can be ...
JSW189's user avatar
  • 725
30 votes
3 answers
532 views

Are the suggested edit audits too easy?

Yes, this might be another post complaining about audits. But, in this case, I want the audits to be more difficult. Specifically, I'm concerned that the suggested edits audits are just too darn easy ...
nneonneo's user avatar
  • 3,631
17 votes
2 answers
384 views

Is there supposed to be feedback on edit-review audits?

I think I passed an edit-review audit today. I rejected something that was so horrible I was sure it was a honeypot. But nothing happened. I checked in the history and yes, it was an audit. I can't ...
Kate Gregory's user avatar
  • 75.1k
52 votes
0 answers
341 views

Moderators should have easy access to a user's complete review history, including audits

We often get questions here on Meta or through other channels about why a particular user was banned from review by the system. Additionally, we frequently want to look into a user's review history ...
Brad Larson's user avatar
  • 60.7k
34 votes
1 answer
272 views

I would like to see my review audit history

Confession: I have been suspended a couple times from reviewing activities. Partial Redemption: I have become better and better at passing audits. I'd like to see my recent and distant history with ...
Dave Alperovich's user avatar
29 votes
1 answer
382 views

Post I voted down and close is shown to me as known good audit?

Post that has been presented as a "known good" audit item is one I voted down and close about two weeks ago (close vote expired). Is the algorithm to pick such items designed to allow posts having ...
gnat's user avatar
  • 11.1k
25 votes
3 answers
471 views

Request for review: close/reopen "known good" audits

The difficulty of some review audits in the /close and /reopen queues has been brought up here a few times recently. It's true: a few of these audits are difficult, if not outright misleading. We've ...
Shog9's user avatar
  • 450k
9 votes
2 answers
292 views

Close Vote Review Audits are too obvious

The other day, I got an obviously good question in a Close Vote Review. Even if I didn't read the question, +11 with 3 answers is a bit of a giveaway. Today I got one where the question was almost ...
Ward - Trying Codidact's user avatar
7 votes
1 answer
167 views

Is it possible to see own 'review queue audits' results?

I completed recently a few review audits, some of them I passed, some I failed. Is there a place I could (easily) find these results?
strah's user avatar
  • 427
5 votes
0 answers
99 views

Audits doesn't take into consideration the filter [duplicate]

I was reviewing "First Posts" queue with "answers" filter, and a wild question appeared: This way is very easy to detect some audits.
SysDragon's user avatar
  • 657
84 votes
2 answers
1k views

Stop bothering me with suggested edit review audits

I have spent considerable time reviewing suggested edits. Less so lately, mainly because of the brokenness around improving, but more and more because those !*#^)(@^&#)@ audits are getting on my ...
Gilles 'SO- stop being evil''s user avatar
77 votes
3 answers
530 views

Give moderators the ability to mark reviews as "bad"

From what I've seen, many SO moderators trawl completed reviews and watch out for robo reviewers; and manual banning them when they see enough (>= 3?) bad reviews. This is inefficient because: It ...
Manishearth's user avatar
  • 79.2k
43 votes
1 answer
431 views

Add "too minor" audits to Suggested Edits review queue

I've thought about proposing this for a while. It would be very easy to make or curate "too minor" review audits. Chances are, many of them are approved. I don't know how big of a problem it is for ...
djechlin's user avatar
  • 14.5k
42 votes
2 answers
256 views

In the review queue, audits should only fail (or pass) you once you actually would take action [duplicate]

I just had a review queue audit question "fail" because I clicked "Close" on a post that the community felt should be left open. This particular meta question is about the close vote review queue, but ...
user's user avatar
  • 8,977
34 votes
2 answers
586 views

Why does pressing the flag button make you fail an audit?

Few arguments against it: Pressing the flag button doesn't mean actually submitting it (as in every test/form). There might be an unknown duplicate, if you assume it's the first post (as you were ...
Yosi Dahari's user avatar
  • 2,108
30 votes
0 answers
260 views

Refreshing the page of a suggested edit audit kills the audit

Steps to repro: Find a suggested edit that seems suspicious (clearly an audit) Press F5 OR Ctrl+R OR the refresh button (who uses the GUI anyway) ... Break the audit! (see image) Link to the audit (...
Hugo Dozois's user avatar
  • 7,574
26 votes
5 answers
634 views

Incorrect audits [closed]

Today, I failed an (unfair and incorrect) audit, the first one in a while, and I'm now banned from reviewing for two days. I naturally find this unfair and stupid, and I would really like to get the ...
Emil's user avatar
  • 1,878
22 votes
2 answers
650 views

Review Audit failed when "late answer" answer is a duplicate

I just got a review audit where the "late answer" was a duplicate of the accepted answer, but flagging it on that basis failed the review. That seems like a bug to me. Question here: Is it better to ...
Móż's user avatar
  • 470
20 votes
1 answer
600 views

How many failed audits to be put on quarantine?

From time to time I fail a review audit. That's another story, but after not having run in to an audit (and certainly not failing one) for over a week, and suddenly failing one, I got banned from ...
Emil's user avatar
  • 1,878
14 votes
1 answer
144 views

Typo on the Close Votes review audit failure message

There is a (very minor) typo in the Close Votes review audit failure message. The message is presented as follows: STOP! Look and Listen. This was an audit, designed to see if you were paying ...
elixenide's user avatar
  • 3,698
13 votes
1 answer
590 views

Review ban after skipping a review

So I received the following message today after clicking the 'Skip' button on a close vote review because I guess I took too long to vote on it and it said it was already closed when I tried to vote. ...
Gordon Seidoh Worley's user avatar
10 votes
1 answer
228 views

Strange Text After Passing Suggested Edit Audit

Not entirely sure what's happening here but it definitely looks wrong: The message popped up at the same time as the Congratulations message. Our system has identified this edit as possible spam; ...
OGHaza's user avatar
  • 989
10 votes
1 answer
194 views

How do we select audits for Reopen review?

I occasionally fail audits for the Reopen review queue. My problem is not that I click without any thoughts, but that I honestly don't think the questions should have been reopened (had they been ...
Bo Persson's user avatar
  • 4,708
-54 votes
3 answers
2k views

Bill the Lizard's Closing Antics [closed]

Bill the Lizard is the number 1 reviewer when it comes to Close Votes. Now I can only respect the amount of time he's put in to sealing that podium position, however he's doing this in such a way that ...
James Donnelly's user avatar
92 votes
2 answers
624 views

Showing comments for a question should not fail a "first answer, known to be good" audit

So this audit came up. It was clearly not a crap answer, and I could tell it was probably an audit because no username was being displayed, but I wanted to read the question before deciding whether to ...
Toomai's user avatar
  • 4,403
89 votes
2 answers
507 views

Give new edit reviewers some audits to begin with

Apparently many new reviewers approve crap that: is just crap 💩 (or spam) introduces backticks to emphasize stuff add typos, chatspeak and other noise. plz help me kind sirs! Giving them some ...
ThiefMaster's user avatar
  • 15.6k
30 votes
4 answers
403 views

Is anyone monitoring people rejecting good edits or approving bad ones?

Right now I can say "good" or "bad" to a proposed edit at my discretion, but is anyone able to see this decision and moderate it? I recently saw a good edit that I was going to approve, but when I ...
jjnguy's user avatar
  • 34.1k
24 votes
2 answers
395 views

YARAFP: Yet Another Review Audit Failed Post [closed]

I just failed a close-vote audit by voting to close this question. I genuinely believe there is a good case for closing it, as the question has a number of issues. Yes, it has five upvotes, an ...
Christian Ternus's user avatar
22 votes
1 answer
144 views

A reopen queue review audit shouldn't show me a question that has an active bounty

While processing the reopen queue on Super User I was presented with this: https://superuser.com/review/reopen/88150 I was immediately suspicious as a) the question was quite detailed and b) the ...
ChrisF's user avatar
  • 100k
20 votes
0 answers
158 views

Close vote review audit is broken - displays "on hold" while reviewing [duplicate]

I just reviewed this: https://stackoverflow.com/review/close/2385381 But while reviewing, it already displays the "put on hold as not a real question" section, and it asked: Should this question ...
zw324's user avatar
  • 736
20 votes
3 answers
548 views

Failed low-quality review audit

I recently came across this answer (to a question on implementing echo cancellation in Java) in the low quality review queue: The only way to supress echo is to use "C" libary of AEC and ...
eggyal's user avatar
  • 2,847
18 votes
1 answer
190 views

'Good' review audits can be misleading [duplicate]

I just failed this review audit. This post looked good; very concise. However given that the question had 5 other answers, I thought the odds of this post being just a repeat of information in another ...
jam's user avatar
  • 923
18 votes
1 answer
206 views

Filtered Review Queue doesn't show any audits

In the last 3 days I have only been reviewing a filtered review queue. That's 120 reviews without a single audit.
user avatar
15 votes
2 answers
580 views

This post was of very poor quality?

I'm a bit embarrassed to admit this, but I failed the review honeypot at https://stackoverflow.com/review/first-posts/1126342. (The question is at How to create a link text in a table using c#.) I ...
KatieK's user avatar
  • 1,650

1
2 3 4 5