Questions tagged [review-audits]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

Filter by
Sorted by
Tagged with
403
votes
5answers
6k views

Add an “I don't understand” option for review audits

Background This is somewhat specific to Stack Overflow. My concern is the "I understand" button that appears when you fail a Review Audit. I had this experience twice recently (after never ...
352
votes
1answer
11k views

What are review tests (audits) and how do they work?

I recently received this rather amusing message while reviewing a user's first post: Congratulations! This was only a test, designed to make sure you were paying attention. This post has already been ...
208
votes
4answers
2k views

Stop using real accounts in suggested edit audits

Well, thanks for making me harass a user over attempting to vandalize a post! Got a flag on a question notifying us that a new, low-rep user submitted a bogus edit suggestion. Okay, so I went and took ...
138
votes
6answers
2k views

The time of automatic review bans should be increased with every new ban

The way the current auto-bans for reviews work is rather suboptimal. Somebody who's really after the badges and doesn't care whether they're banned for two days can just continue clicking through, ...
132
votes
3answers
3k views

Why am I getting the message “You've failed too many recent review audits”? [duplicate]

Today I clicked on Review and saw the message below. You've failed too many recent review audits - looks like you might need a break. Come back in in 7 days and try again. Why does this type of ...
130
votes
1answer
2k views

Bring a “human factor” into review audit composition/selection

Some people are complaining about the automatically generated audits. They are based on close reasons and apparently are a little controversial :-) Failed low-quality review audit Reopen Question ...
120
votes
3answers
1k views

Adding a comment should not make me fail the review audit

I just failed these review audits in First Post, I read the question and thought it seemed reasonable but the user was deleted so to be on the safe side I clicked add comment and I failed the audit. ...
117
votes
3answers
1k views

Close vote review audit flawed - fails without casting vote

Having just failed my first review audit from any of the queues, it was reviewing close votes; however, this audit was flawed in that I didn't even cast a close vote. Often I press the Close button ...
114
votes
2answers
3k views

“STOP! Look and Listen” audit tricked me

I have noticed this "STOP! Look and Listen" message when the system audits you by having you review something to check how you respond. However, this audit came up and I was tricked. I wanted to up ...
96
votes
5answers
3k views

Why no honeypot suggested edits?

While the review audits are great and much needed, as far as I can tell they do not apply for the suggested edits queue. Robo reviewers can still approve crap and smile all the way to their badges. ...
92
votes
2answers
609 views

Showing comments for a question should not fail a “first answer, known to be good” audit

So this audit came up. It was clearly not a crap answer, and I could tell it was probably an audit because no username was being displayed, but I wanted to read the question before deciding whether to ...
90
votes
1answer
932 views

Don't use spam post as audits in the low quality review queue

Spam posts, without proper context, especially those tricky ones, can be extremely difficult to assess; and even when you successfully identify it as "spam" the review queue doesn't allow you to flag ...
87
votes
2answers
488 views

Give new edit reviewers some audits to begin with

Apparently many new reviewers approve crap that: is just crap 💩 (or spam) introduces backticks to emphasize stuff add typos, chatspeak and other noise. plz help me kind sirs! Giving them some ...
84
votes
0answers
288 views

Posts destroyed as spam should trigger a retroactive audit failure for previous “No Action Needed” votes

As a moderator on Stack Overflow, I regularly look through the review history of obvious spam that has lasted more than an hour or so on the site. I often find one or two reviewers who voted "No ...
80
votes
3answers
2k views

Improving the Quality of Reviews: Project Honeypot

There has been a lot of discussion/complaints about the quality of reviews. Many have noted that a large (maybe even a majority) of reviews are rubber stamps in pursuit of a Steward badge (especially ...
79
votes
2answers
1k views

Stop bothering me with suggested edit review audits

I have spent considerable time reviewing suggested edits. Less so lately, mainly because of the brokenness around improving, but more and more because those !*#^)(@^&#)@ audits are getting on my ...
77
votes
3answers
515 views

Give moderators the ability to mark reviews as “bad”

From what I've seen, many SO moderators trawl completed reviews and watch out for robo reviewers; and manual banning them when they see enough (>= 3?) bad reviews. This is inefficient because: It ...
73
votes
6answers
870 views

“Improve” treated as improper response to proper response to audit

For the first time I failed an audit in review, but I sure don't think I should have. I saw the edit wasn't that good, so I hit the improve button to clean things up and got this message: This was ...
65
votes
1answer
1k views

Review-beta: Obviously good answer in low-quality

Today I came across an OBVIOUSLY good answer in /review. It had 7 upvotes, contained lists, paragraphs of explanation, and well-applied sample code. It was also moderately long. How does a question ...
64
votes
1answer
674 views

Too many review audits

I just had 8 review audits in a row without an actual review in the first post review queue on Stack Overflow. Same thing happens in the Late Answers queue and the Low Quality Posts queue. Is this ...
53
votes
4answers
538 views

Spam-polishing audits

A truly horrific thing happened on 2014-02-26: In case you can't see that, that's blatant spam. With a suggested edit to fix its link. That edit was unanimously approved. A suggested edit to fix ...
52
votes
0answers
333 views

Moderators should have easy access to a user's complete review history, including audits

We often get questions here on Meta or through other channels about why a particular user was banned from review by the system. Additionally, we frequently want to look into a user's review history ...
46
votes
1answer
528 views

Comment on an answer before it existed

I just found this answer on the "New answers to old questions" list, and looking at the comment I was shocked to see it was coming... from the past! Is this a bug? EDIT: Summarizing what's been ...
43
votes
1answer
419 views

Add “too minor” audits to Suggested Edits review queue

I've thought about proposing this for a while. It would be very easy to make or curate "too minor" review audits. Chances are, many of them are approved. I don't know how big of a problem it is for ...
43
votes
1answer
330 views

Review trap shows post that was bad, after it has been edited

So I was going through the First Posts review queue, and got trapped by a "honey pot" post after voting up an answer. Oops, this is embarrassing! Or so I thought, until further inspection: This ...
42
votes
2answers
245 views

In the review queue, audits should only fail (or pass) you once you actually would take action [duplicate]

I just had a review queue audit question "fail" because I clicked "Close" on a post that the community felt should be left open. This particular meta question is about the close vote review queue, but ...
42
votes
1answer
357 views

Why doesn't attempting to edit count as a pass for a review audit?

I just got a question in the review queue that, though poor, I thought was potentially salvageable via editing. However when I clicked the Edit button I got the deleted post error. Since the post ...
41
votes
2answers
452 views

Your review was inappropriate [closed]

I was recently reviewing first posts on SO when I was presented with this response: Why does the C preprocessor interpret the word "linux" as the constant "1"? Which it obviously ...
40
votes
5answers
696 views

Delete informative code-only answers? Not!

Since we emptied the giant LQ backlog, I've been given the TSA screener treatment a few times. Which is to say, I've been presented with an answer, asked to react to it, and then told that: it was a ...
38
votes
4answers
364 views

Make a kinder, gentler audit failure message for first-time errors versus patterns of abuse

Many hard-working, diligent people here have felt unjustly insulted and dumped upon by the 'STOP!' message. Maybe we made an honest mistake, maybe we hit a bum audit. The stern wording is justified ...
36
votes
1answer
431 views

Add tag wiki/excerpt audits with copied content [duplicate]

In line with the proposal of Shog to improve the reject reasons, I think we should also teach reviewers to search for plagiarization whenever they hit a tag wiki/excerpt edit. So, I suggest that ...
35
votes
1answer
311 views

Clearly wrong close review audit - what action to take? [duplicate]

I'm failing a non-zero amount of review audit question. Some of them are borderline which are a teaching moment for me. Others are clearly incorrect, and the question is totally inappropriate for ...
35
votes
1answer
578 views

User making inappropriate edits with backticks

This user has been making a lot of suggested edits that are essentially just adding backticks around words - while some are being rejected, some are also being approved when they shouldn't be. For ...
34
votes
2answers
582 views

Why does pressing the flag button make you fail an audit?

Few arguments against it: Pressing the flag button doesn't mean actually submitting it (as in every test/form). There might be an unknown duplicate, if you assume it's the first post (as you were ...
34
votes
1answer
528 views

How many review audits did I fail?

I have been looking around for a while now, but I can't see anywhere how many audits I have failed. Is this purposely not being exposed to users? Where can I see some history of the audits I have ...
33
votes
1answer
558 views

How many failed audits trigger a review suspension?

I failed an audit in the suggested edits queue today. No excuses on my part, it was (in hindsight) an obviously invalid edit and I wasn't paying proper attention. However, what I found odd is that I ...
33
votes
1answer
808 views

Failed a Reopen Question audit — sure looks like “Not a real question” to me [duplicate]

I just failed this audit here, which was shown as being closed as "Not a real question". Seeing as the vote count was positive, I figured it was an audit, but I selected "Leave Closed" anyways ...
33
votes
1answer
462 views

It's rather difficult to look over an answer that doesn't exist

I just now failed an audit. When I went to review the audit, I was surprised to find it impossible to actually look over the answer. Here's a screenshot: (Ha. Of course a nonexistent post contains ...
33
votes
1answer
234 views

Stop a click on “add comment” failing “known good” audits [duplicate]

After failing another audit, I really believe that comments on audits should be considered a neutral action, just like how clicking the link to the full question/answer is not considered. The logic ...
33
votes
0answers
237 views

“Reject and Edit” failed me in review audit. Why? [closed]

I was reviewing a suggested edit which is clearly wrong and I chose to reject it and then edit the post. Why did I fail? Here is a screenshot:
32
votes
1answer
251 views

I would like to see my review audit history

Confession: I have been suspended a couple times from reviewing activities. Partial Redemption: I have become better and better at passing audits. I'd like to see my recent and distant history with ...
31
votes
2answers
683 views

Using the “flag” loophole to pass every review audit

My question pertains to the review audits that occasionally appear when using the "review" feature on Stack Overflow. I know that if you fail too many of these audits, your reviewing privileges can be ...
31
votes
0answers
349 views

Please don't use comments containing vulgarities for suggested edit review audits

I come across this comment while reviewing a suggested edit audit: I don't think system-generated messages should contain such language. Can they be chosen more carefully, please?
30
votes
2answers
463 views

Do I ever get rid of “congratulations, this was only a test” message?

To begin with, I thought it was a great idea. Testing if people really cared. But now I have more than 7k, proven I not intend to destroy the community. I edit post after post, and every time - "...
30
votes
4answers
390 views

Is anyone monitoring people rejecting good edits or approving bad ones?

Right now I can say "good" or "bad" to a proposed edit at my discretion, but is anyone able to see this decision and moderate it? I recently saw a good edit that I was going to approve, but when I ...
30
votes
1answer
318 views

Review Audit/Commenting on good questions discouraged?

Today I failed yet another review audit (and was subsequently banned) while reviewing first posts. It was a perfectly good post, and I intended to comment on it to point out the name of what they ...
30
votes
1answer
348 views

Audits bug in the filtered review queue

Just recently the audits have been introduced to filtered review queues. I've got an audit this morning which seems to be out of scope for my filtered list. I have filtered my list to only review VBA ...
30
votes
1answer
247 views

Review Audit: highly upvoted but closed question

I did some First Post Reviews today and eventually got this question as an audit C++ What optimizations do compilers still struggle with? It has 20 upvotes but it's (rightly) closed as not ...
30
votes
0answers
405 views

Don't make us click through the reject dialog on Suggested Edit audits

tl;dr: Make the reject button in the suggested edit queue pass audits without a dialog. I've reviewed over 700 suggested edits, so I have had my fair share of audits. Unlike the other queues, ...
30
votes
0answers
248 views

Refreshing the page of a suggested edit audit kills the audit

Steps to repro: Find a suggested edit that seems suspicious (clearly an audit) Press F5 OR Ctrl+R OR the refresh button (who uses the GUI anyway) ... Break the audit! (see image) Link to the audit (...

1
2 3 4 5
13