Questions tagged [review-audits]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

Filter by
Sorted by
Tagged with
334
votes
1answer
10k views

What are review tests (audits) and how do they work?

I recently received this rather amusing message while reviewing a user's first post: Congratulations! This was only a test, designed to make sure you were paying attention. This post has ...
131
votes
3answers
3k views

Why am I getting the message “You've failed too many recent review audits”? [duplicate]

Today I clicked on Review and saw the message below. You've failed too many recent review audits - looks like you might need a break. Come back in in 7 days and try again. Why does this type of ...
12
votes
0answers
239 views

Exclude posts with valid “rude or abusive” flags from appearing as review audits in all review queues

Recently our member reported about inappropriate content in the question in a First Posts review audit. The question was deleted by a moderator, because it contains NSFW pictures. Can you do ...
8
votes
3answers
464 views

Audit fail message and our more friendly community

I'm more of a reader than a contributor on SO, but I try to jump in sometimes when I can. I tried to triage a post today and it turned out to be an audit. I suggested a moderator review because it had ...
0
votes
1answer
36 views

Filter by tag in Close Votes review gives question without that tag

I was reviewing python Close Votes in the review queues. When I pressed 'Next' in the review page, it gives me a question which is not related to python. Check below screenshot
4
votes
0answers
46 views

Review queue audit doesn’t take current filter mode into account

In some review queues like First Posts or Low Quality Posts there is ability to set a filter by the post type: question or answer. In case of audit there can be a wrong post type for review. For ...
11
votes
0answers
269 views

Does edit of an audit review question/answer now always result in a failed audit?

Over the past week or so, on some SE site, I failed an audit review. And this happened after I used the "edit" link during such review. It was about a terribly formatted question, so I used the "edit" ...
14
votes
0answers
81 views

Reopen Votes review audits use old JS confirm dialog instead of new Stacks prompt, making them too easy to identify

If I vote to reopen a question that appeared on the Reopen Votes queue and it turns out that it is an audit, I get this JS browser confirmation dialog: But if it is not an audit, then I get this ...
29
votes
1answer
299 views

Review Audit/Commenting on good questions discouraged?

Today I failed yet another review audit (and was subsequently banned) while reviewing first posts. It was a perfectly good post, and I intended to comment on it to point out the name of what they ...
7
votes
0answers
80 views

Past audits on deleted posts fail to render due to JS error

I recently stumbled onto an old post which mentioned the following failed audit on this question (deleted): https://stackoverflow.com/review/low-quality-posts/19920226 This is what's rendered: (...
13
votes
2answers
106 views

Request: Link to reviewer guidelines from the review interface

Currently the review interface, at least for First Posts on Stack Overflow, looks like this: There are several lines of text describing the meaning of the various buttons, but almost no guidelines ...
9
votes
0answers
59 views

Audit is too obvious because button offers to “Recommend…” a vote

I just encountered the following question in SuperUser's VLQ review queue, which made the audit pathetically obvious because I haven't Recommended close votes for a long time: As a reviewer who ...
8
votes
1answer
131 views

Review Audit failed when “late answer” answer is a duplicate

I just got a review audit where the "late answer" was a duplicate of the accepted answer, but flagging it on that basis failed the review. That seems like a bug to me. Question here: Is it better to ...
1
vote
0answers
31 views

While in an audit, you can't add a comment [duplicate]

Just got to decide if an answer should be deleted. It was only a link, no comments. So I wanted to add a comment explaining why link only answers aren't welcome, and got "This is an audit". This ...
8
votes
1answer
85 views

Exclude reopened questions from Close Vote audits

Apparently, poor questions which were quickly closed with no answers are used as audits even after such questions are edited, reopened and answered. Since audits present the latest revision of the ...
7
votes
2answers
185 views

Increasing frequency of review audits

While reviewing suggested edits during the last week or so, I noticed many weird spammy edits. I then realized by looking at my history that it was an audit. I have been seeing those audits nearly ...
376
votes
5answers
5k views

Add an “I don't understand” option for review audits

Background This is somewhat specific to Stack Overflow. My concern is the "I understand" button that appears when you fail a Review Audit. I had this experience twice recently (after never having ...
83
votes
1answer
814 views

Don't use spam post as audits in the low quality review queue

Spam posts, without proper context, especially those tricky ones, can be extremely difficult to assess; and even when you successfully identify it as "spam" the review queue doesn't allow you to flag ...
37
votes
1answer
424 views

Add tag wiki/excerpt audits with copied content [duplicate]

In line with the proposal of Shog to improve the reject reasons, I think we should also teach reviewers to search for plagiarization whenever they hit a tag wiki/excerpt edit. So, I suggest that ...
4
votes
0answers
100 views

Lack of new contributor indicator outs review audits

Occasionally, when I get a known-good audit in the review queue, the system shows me a fake usercard of a new user to not make it obvious that it is an audit; as it was actually posted by a higher-rep ...
3
votes
0answers
93 views

Failing Review Audit because I added a comment that it was a duplicate post [duplicate]

I reviewed a post in the Super User First Post queue and thought it sounded familiar. I searched for the subject and found a previous post with the same question. I then added a comment ...
25
votes
1answer
107 views

Can we have a mod tool to prevent posts from being selected for review audits, without invalidating flags?

I've been wanting to ask this question for some time. This question is a clear example of the need for the request: Wrong review question? Quoting from the answer: I handled the flags and ...
3
votes
1answer
57 views

Is the behavior of a user concerning audits used to decide whether they will get audits?

Suppose that I fail to pass several review audits in a short time span. Will the system take that into account, in the sense that more of my reviews will be audits? I mean, in order to check whether ...
6
votes
0answers
77 views

In Stack Overflow en español, review audits do not show in the activity tab

On October 2018, review audits were activated in Stack Overflow en español. They have been working well and we all are very happy. However, I noticed that audit reviews do not show in the activity ...
203
votes
4answers
1k views

Stop using real accounts in suggested edit audits

Well, thanks for making me harass a user over attempting to vandalize a post! Got a flag on a question notifying us that a new, low-rep user submitted a bogus edit suggestion. Okay, so I went and ...
127
votes
1answer
2k views

Bring a “human factor” into review audit composition/selection

Some people are complaining about the automatically generated audits. They are based on close reasons and apparently are a little controversial :-) Failed low-quality review audit Reopen Question ...
-16
votes
3answers
213 views

Review audit questions in a foreign language need a translated version so we can easily see if they are SPAM, migratable, or should simply be deleted

During review audits sometimes questions are written in a foreign language and determining what would be the fairest outcome for the person requires the auditor to either be fluent in a foreign ...
1
vote
1answer
50 views

Why are comments shown in this audit, but I cannot click the two additional comments?

I just passed this audit. Why is there one comment shown (which basically gives you a hint, that this is possibly spam)? Clicking the additional comments won't work and tells you, and this is an ...
6
votes
1answer
88 views

How does a site initiate a request for having review audits?

This is a follow-up question to Which sites currently have review-audits? Not every site has review audits active. So, how does a site go about requesting to have review audits initiated? Is there ...
2
votes
0answers
38 views

Should the user's name be shown as part of review audits, or some other non-confusing alternative?

I was shown the below answer as part of "First Post" reviews. https://stackoverflow.com/a/52477657/9134487 The name was shown as a different user, with a recent timestamp, and with 0 upvotes. Though,...
3
votes
1answer
103 views

A Reviewer Rating [duplicate]

I noticed some real egregious reviewing on this question. It was closed as a duplicate of a question that it doesn't come close to duplicating, the OP's problem being that of formatting Excel via C#, ...
0
votes
1answer
51 views

Comments shown in review audits should be re-dated

Inspired by this question, where this review audit shows the question as posted as a few minutes ago, while the comments are much older (May 24th). This makes it very easy to see it's a review audit. ...
5
votes
1answer
177 views

While reviewing “The Late answers” should we compare it to other answers?

When I was reviewing the Late answers on Stack Overflow I "failed" on the following audit question: Which happened to be just a copy and paste of the of the accepted and well-received answer My ...
13
votes
4answers
319 views

Review audits should not be counted to the count of daily reviews

I propose to make review audits not counting to the count of daily reviews. Why? Because reviewing review audits doesn't give anything for SE community (review audits are only checking is reviewer ...
3
votes
0answers
59 views

Pre-generate Review audits to avoid the lag?

When reviewing on Suggested Edits: Normal suggested edits are displayed instantly. Review audits take 2 seconds to load (and that's not because of my ISP). So whenever I see the loading animation ...
3
votes
0answers
150 views

Viewing vote counts while reviewing immediately unmasks review audits

Assume you're performing a review of either a First post or Late answer (on any SE site where audit reviews are enabled). If you do have the Established Users privilege on that site, you can also "...
3
votes
1answer
126 views

Possibly incorrect reopen review-audit test question [closed]

TLDR Post-Mortem I failed a reopen review audit because I neglected to extend the benefit-of-the-doubt to the OP of a relevant question about an interesting new language, but instead treated him like ...
6
votes
0answers
111 views

Why do you fail audit by using the edit link while viewing is allowed?

Apart of what I described in "Does edit of an audit review question/answer now always result in a failed audit?", I now noticed that it is still OK to browse a question during an audit review (by just ...
13
votes
1answer
166 views

Gradually lowering the frequency of review audits for users proven to be trustworthy

Now, I'm aware of this question: Too many review audits But it was essentially a bug report, and it was beyond debate that the system was broken for a while. I still think I'm getting review audits ...
42
votes
2answers
241 views

In the review queue, audits should only fail (or pass) you once you actually would take action [duplicate]

I just had a review queue audit question "fail" because I clicked "Close" on a post that the community felt should be left open. This particular meta question is about the close vote review queue, but ...
8
votes
0answers
146 views

“Race condition” prevention not implemented on review audits

Link to the strange behavior: https://stackoverflow.com/review/low-quality-posts/18484797 I identified it's a spam and clicked "Recommend Deletion", then hit "Delete", and there was no doubt I was ...
3
votes
1answer
93 views

Are comments review test (audit) posted?

When doing a review, I added a comment, then clicked "I'm done". The system said "This was only a test, ...". Will my comment be posted anyway?
9
votes
0answers
94 views

Don't let users comment on review audit questions

When reviewing reopen votes, I was given this question as a review audit. I commented, nonsensically, that I didn't understand why the question was closed as primarily-opinion based, as that's what ...
5
votes
2answers
78 views

Don't accept comments during review audit

For the nth time this month, I've written a considered, thought-out comment to help guide the poster of an off-topic question to a more useful resource - only to find that after all my thought and ...
1
vote
0answers
40 views

Reviewing “timeout” period for audit failure

I have searched high and low but have been unable to find an explanation of why the timeout period for audit failures gets longer and longer. I fully understand and support the use of the audits and, ...
5
votes
2answers
87 views

How to distinguish audits from real reviews in SEDE data?

I was trying to look at some statistics on review outcomes using SEDE, but hit upon a snag: apparently, the SEDE ReviewTasks table also includes audit tasks, and there doesn't seem to be any way to ...
-9
votes
2answers
108 views

Answers which are considered too short to be a good answer shouldn't be used for review audits [duplicate]

I have had review audits several times in the review queues which are mostly fine. They usually included a short (non comprehensive) description of the solution and a link to a howto with the full ...
5
votes
1answer
68 views

Is there a way to know whether a post is being used as a pending audit?

Currently, on the sites with review audits enabled (SO, SU, SF, AU, SoftwareEng, Maths), you can see if a post is used for review audits by visiting its timeline: https://<siteurl>/posts/<id&...
6
votes
1answer
148 views

Be more friendly to hard-working reviewers

I had been banned from review 2 times on Stack Overflow before this event came up. After my 2nd ban, I've been working carefully, doing 80+ reviews every day and passing ~30 audits (I think there's ...
43
votes
1answer
410 views

Add “too minor” audits to Suggested Edits review queue

I've thought about proposing this for a while. It would be very easy to make or curate "too minor" review audits. Chances are, many of them are approved. I don't know how big of a problem it is for ...

1 2 3 4 5 12