Skip to main content

Questions tagged [review-audits]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

Filter by
Sorted by
Tagged with
433 votes
5 answers
6k views

Add an "I don't understand" option for review audits

Background This is somewhat specific to Stack Overflow. My concern is the "I understand" button that appears when you fail a Review Audit. I had this experience twice recently (after never ...
hardmath's user avatar
  • 5,268
374 votes
1 answer
12k views

What are review tests (audits) and how do they work?

I sometimes receive this rather amusing message while reviewing in the review queues: Congratulations! This was only a test, designed to make sure you were paying attention. You passed. If I am not ...
218 votes
4 answers
2k views

Stop using real accounts in suggested edit audits

Well, thanks for making me harass a user over attempting to vandalize a post! Got a flag on a question notifying us that a new, low-rep user submitted a bogus edit suggestion. Okay, so I went and took ...
user avatar
142 votes
6 answers
2k views

The time of automatic review bans should be increased with every new ban

The way the current auto-bans for reviews work is rather suboptimal. Somebody who's really after the badges and doesn't care whether they're banned for two days can just continue clicking through, ...
slhck's user avatar
  • 34.8k
137 votes
1 answer
2k views

Bring a "human factor" into review audit composition/selection

Some people are complaining about the automatically generated audits. They are based on close reasons and apparently are a little controversial :-) Failed low-quality review audit Reopen Question ...
Kate Gregory's user avatar
  • 75.1k
135 votes
3 answers
3k views

Why am I getting the message "You've failed too many recent review audits"? [duplicate]

Today I clicked on Review and saw the message below. You've failed too many recent review audits - looks like you might need a break. Come back in in 7 days and try again. Why does this type of ...
124 votes
3 answers
1k views

Adding a comment should not make me fail the review audit

I just failed these review audits in First Post, I read the question and thought it seemed reasonable but the user was deleted so to be on the safe side I clicked add comment and I failed the audit. ...
Aboutblank's user avatar
  • 1,530
118 votes
3 answers
2k views

Close vote review audit flawed - fails without casting vote

Having just failed my first review audit from any of the queues, it was reviewing close votes; however, this audit was flawed in that I didn't even cast a close vote. Often I press the Close button ...
Jason Sturges's user avatar
117 votes
2 answers
3k views

"STOP! Look and Listen" audit tricked me

I have noticed this "STOP! Look and Listen" message when the system audits you by having you review something to check how you respond. However, this audit came up and I was tricked. I wanted to up ...
Austin Henley's user avatar
111 votes
2 answers
1k views

Don't use spam post as audits in the low quality review queue

Spam posts, without proper context, especially those tricky ones, can be extremely difficult to assess; and even when you successfully identify it as "spam" the review queue doesn't allow you to flag ...
Braiam's user avatar
  • 15.3k
98 votes
5 answers
3k views

Why no honeypot suggested edits?

While the review audits are great and much needed, as far as I can tell they do not apply for the suggested edits queue. Robo reviewers can still approve crap and smile all the way to their badges. ...
Shadow Wizard Love Zelda's user avatar
98 votes
0 answers
468 views

Posts destroyed as spam should trigger a retroactive audit failure for previous "No Action Needed" votes

As a moderator on Stack Overflow, I regularly look through the review history of obvious spam that has lasted more than an hour or so on the site. I often find one or two reviewers who voted "No ...
Brad Larson's user avatar
  • 60.7k
92 votes
2 answers
624 views

Showing comments for a question should not fail a "first answer, known to be good" audit

So this audit came up. It was clearly not a crap answer, and I could tell it was probably an audit because no username was being displayed, but I wanted to read the question before deciding whether to ...
Toomai's user avatar
  • 4,403
89 votes
2 answers
507 views

Give new edit reviewers some audits to begin with

Apparently many new reviewers approve crap that: is just crap 💩 (or spam) introduces backticks to emphasize stuff add typos, chatspeak and other noise. plz help me kind sirs! Giving them some ...
ThiefMaster's user avatar
  • 15.6k
84 votes
2 answers
1k views

Stop bothering me with suggested edit review audits

I have spent considerable time reviewing suggested edits. Less so lately, mainly because of the brokenness around improving, but more and more because those !*#^)(@^&#)@ audits are getting on my ...
Gilles 'SO- stop being evil''s user avatar
80 votes
3 answers
2k views

Improving the Quality of Reviews: Project Honeypot

There has been a lot of discussion/complaints about the quality of reviews. Many have noted that a large (maybe even a majority) of reviews are rubber stamps in pursuit of a Steward badge (especially ...
Ben D's user avatar
  • 2,108
77 votes
3 answers
530 views

Give moderators the ability to mark reviews as "bad"

From what I've seen, many SO moderators trawl completed reviews and watch out for robo reviewers; and manual banning them when they see enough (>= 3?) bad reviews. This is inefficient because: It ...
Manishearth's user avatar
  • 79.2k
73 votes
6 answers
891 views

"Improve" treated as improper response to proper response to audit

For the first time I failed an audit in review, but I sure don't think I should have. I saw the edit wasn't that good, so I hit the improve button to clean things up and got this message: This was ...
Lance Roberts's user avatar
65 votes
1 answer
1k views

Review-beta: Obviously good answer in low-quality

Today I came across an OBVIOUSLY good answer in /review. It had 7 upvotes, contained lists, paragraphs of explanation, and well-applied sample code. It was also moderately long. How does a question ...
Dustin's user avatar
  • 1,963
64 votes
1 answer
692 views

Too many review audits

I just had 8 review audits in a row without an actual review in the first post review queue on Stack Overflow. Same thing happens in the Late Answers queue and the Low Quality Posts queue. Is this ...
FDinoff's user avatar
  • 1,207
55 votes
4 answers
560 views

Spam-polishing audits

A truly horrific thing happened on 2014-02-26: In case you can't see that, that's blatant spam. With a suggested edit to fix its link. That edit was unanimously approved. A suggested edit to fix ...
michaelb958--GoFundMonica's user avatar
52 votes
0 answers
341 views

Moderators should have easy access to a user's complete review history, including audits

We often get questions here on Meta or through other channels about why a particular user was banned from review by the system. Additionally, we frequently want to look into a user's review history ...
Brad Larson's user avatar
  • 60.7k
46 votes
1 answer
533 views

Comment on an answer before it existed

I just found this answer on the "New answers to old questions" list, and looking at the comment I was shocked to see it was coming... from the past! Is this a bug? EDIT: Summarizing what's been ...
Xavi López's user avatar
  • 1,466
43 votes
1 answer
431 views

Add "too minor" audits to Suggested Edits review queue

I've thought about proposing this for a while. It would be very easy to make or curate "too minor" review audits. Chances are, many of them are approved. I don't know how big of a problem it is for ...
djechlin's user avatar
  • 14.5k
43 votes
1 answer
336 views

Review trap shows post that was bad, after it has been edited

So I was going through the First Posts review queue, and got trapped by a "honey pot" post after voting up an answer. Oops, this is embarrassing! Or so I thought, until further inspection: This ...
McGarnagle's user avatar
  • 1,587
42 votes
2 answers
256 views

In the review queue, audits should only fail (or pass) you once you actually would take action [duplicate]

I just had a review queue audit question "fail" because I clicked "Close" on a post that the community felt should be left open. This particular meta question is about the close vote review queue, but ...
user's user avatar
  • 8,977
42 votes
1 answer
376 views

Why doesn't attempting to edit count as a pass for a review audit?

I just got a question in the review queue that, though poor, I thought was potentially salvageable via editing. However when I clicked the Edit button I got the deleted post error. Since the post ...
Dan Is Fiddling By Firelight's user avatar
41 votes
2 answers
461 views

Your review was inappropriate [closed]

I was recently reviewing first posts on SO when I was presented with this response: Why does the C preprocessor interpret the word "linux" as the constant "1"? Which it obviously ...
Tomdarkness's user avatar
39 votes
5 answers
710 views

Delete informative code-only answers? Not!

Since we emptied the giant LQ backlog, I've been given the TSA screener treatment a few times. Which is to say, I've been presented with an answer, asked to react to it, and then told that: it was a ...
Rosinante's user avatar
  • 43.6k
38 votes
4 answers
368 views

Make a kinder, gentler audit failure message for first-time errors versus patterns of abuse

Many hard-working, diligent people here have felt unjustly insulted and dumped upon by the 'STOP!' message. Maybe we made an honest mistake, maybe we hit a bum audit. The stern wording is justified ...
Rosinante's user avatar
  • 43.6k
36 votes
1 answer
435 views

Add tag wiki/excerpt audits with copied content [duplicate]

In line with the proposal of Shog to improve the reject reasons, I think we should also teach reviewers to search for plagiarization whenever they hit a tag wiki/excerpt edit. So, I suggest that ...
Braiam's user avatar
  • 15.3k
35 votes
1 answer
315 views

Clearly wrong close review audit - what action to take? [duplicate]

I'm failing a non-zero amount of review audit question. Some of them are borderline which are a teaching moment for me. Others are clearly incorrect, and the question is totally inappropriate for ...
Danack's user avatar
  • 1,055
35 votes
1 answer
648 views

User making inappropriate edits with backticks

This user has been making a lot of suggested edits that are essentially just adding backticks around words - while some are being rejected, some are also being approved when they shouldn't be. For ...
Krease's user avatar
  • 1,279
34 votes
1 answer
583 views

How many failed audits trigger a review suspension?

I failed an audit in the suggested edits queue today. No excuses on my part, it was (in hindsight) an obviously invalid edit and I wasn't paying proper attention. However, what I found odd is that I ...
Mansfield's user avatar
  • 1,398
34 votes
1 answer
272 views

I would like to see my review audit history

Confession: I have been suspended a couple times from reviewing activities. Partial Redemption: I have become better and better at passing audits. I'd like to see my recent and distant history with ...
Dave Alperovich's user avatar
34 votes
1 answer
861 views

Failed a Reopen Question audit — sure looks like "Not a real question" to me [duplicate]

I just failed this audit here, which was shown as being closed as "Not a real question". Seeing as the vote count was positive, I figured it was an audit, but I selected "Leave Closed" anyways ...
LittleBobbyTables - Au Revoir's user avatar
34 votes
2 answers
586 views

Why does pressing the flag button make you fail an audit?

Few arguments against it: Pressing the flag button doesn't mean actually submitting it (as in every test/form). There might be an unknown duplicate, if you assume it's the first post (as you were ...
Yosi Dahari's user avatar
  • 2,108
34 votes
1 answer
531 views

How many review audits did I fail?

I have been looking around for a while now, but I can't see anywhere how many audits I have failed. Is this purposely not being exposed to users? Where can I see some history of the audits I have ...
user avatar
34 votes
0 answers
247 views

"Reject and Edit" failed me in review audit. Why? [closed]

I was reviewing a suggested edit which is clearly wrong and I chose to reject it and then edit the post. Why did I fail? Here is a screenshot:
Sam R.'s user avatar
  • 479
33 votes
2 answers
557 views

Do I ever get rid of "congratulations, this was only a test" message?

To begin with, I thought it was a great idea. Testing if people really cared. But now I have more than 7k, proven I don't intend to destroy the community. I edit post after post, and every time - &...
davidkonrad's user avatar
  • 1,322
33 votes
1 answer
463 views

It's rather difficult to look over an answer that doesn't exist

I just now failed an audit. When I went to review the audit, I was surprised to find it impossible to actually look over the answer. Here's a screenshot: (Ha. Of course a nonexistent post contains ...
user avatar
33 votes
1 answer
236 views

Stop a click on "add comment" failing "known good" audits [duplicate]

After failing another audit, I really believe that comments on audits should be considered a neutral action, just like how clicking the link to the full question/answer is not considered. The logic ...
Qantas 94 Heavy's user avatar
32 votes
2 answers
716 views

Using the "flag" loophole to pass every review audit

My question pertains to the review audits that occasionally appear when using the "review" feature on Stack Overflow. I know that if you fail too many of these audits, your reviewing privileges can be ...
JSW189's user avatar
  • 725
32 votes
0 answers
371 views

Please don't use comments containing vulgarities for suggested edit review audits

I come across this comment while reviewing a suggested edit audit: I don't think system-generated messages should contain such language. Can they be chosen more carefully, please?
Win's user avatar
  • 447
30 votes
3 answers
532 views

Are the suggested edit audits too easy?

Yes, this might be another post complaining about audits. But, in this case, I want the audits to be more difficult. Specifically, I'm concerned that the suggested edits audits are just too darn easy ...
nneonneo's user avatar
  • 3,631
30 votes
4 answers
403 views

Is anyone monitoring people rejecting good edits or approving bad ones?

Right now I can say "good" or "bad" to a proposed edit at my discretion, but is anyone able to see this decision and moderate it? I recently saw a good edit that I was going to approve, but when I ...
jjnguy's user avatar
  • 34.1k
30 votes
1 answer
323 views

Review Audit/Commenting on good questions discouraged?

Today I failed yet another review audit (and was subsequently banned) while reviewing first posts. It was a perfectly good post, and I intended to comment on it to point out the name of what they ...
Matt Bryant's user avatar
30 votes
1 answer
364 views

Audits bug in the filtered review queue

Just recently the audits have been introduced to filtered review queues. I've got an audit this morning which seems to be out of scope for my filtered list. I have filtered my list to only review VBA ...
user avatar
30 votes
1 answer
255 views

Review Audit: highly upvoted but closed question

I did some First Post Reviews today and eventually got this question as an audit C++ What optimizations do compilers still struggle with? It has 20 upvotes but it's (rightly) closed as not ...
void's user avatar
  • 2,494
30 votes
0 answers
408 views

Don't make us click through the reject dialog on Suggested Edit audits

tl;dr: Make the reject button in the suggested edit queue pass audits without a dialog. I've reviewed over 700 suggested edits, so I have had my fair share of audits. Unlike the other queues, ...
Undo's user avatar
  • 50.8k

1
2 3 4 5
13