7

In the Meta Stack Exchange FAQ of review tests (audits), it is mentioned:

Also, if you find something in the review audit system that makes audits extremely obvious (as in one can tell that a review is an audit in just a few seconds, with little to no extra investigation), feel free to report that flaw.

So, the goal of this post is to report such a flaw.

Screenshot of review test (audit)

This is the audit in question.

In the above screenshot we can notice that the question has 0 answers. So it's pretty obvious to the reviewer that this review is an audit.

If the answer we are looking at is deleted, but the question is shown in its current state, it will cause the answer count not to be the number of other answers +1, as it always should be.

This flaw is immediately obvious if one is looking for it, so it seems highly exploitable.

I asked about this on Ask Ubuntu Meta and one of the moderators in Ask Ubuntu does agree that this is a flaw which needs to be reported.

  • 5
    This is by-design. Audits aren't meant to be hard. The fact that you notice the amount of answers on the question is already a sign that you are paying attention. You'd be amazed how many would fail an audit like this, because they aren't paying attention. – Luuklag Sep 8 at 10:37
  • 4
    @Luuklag Dedicated robo-reviewers would look for any easy giveaways like this, I think. I doubt it's by design that these numbers get mismatched when the post is deleted. Also, mods can't remove audits... – Zanna Sep 8 at 10:40
  • 3
    :p it used to say “other answers: -1”: meta.stackexchange.com/q/165094/323179 – Laurel Sep 8 at 10:53
  • 1
    I was the one who added that paragraph to the FAQ. The idea was that obvious ways to detect audits, as in those that can be exploited by a robo-reviewer to pass them while continuing their robo-reviewing, are OK to report. I'm not entirely sure that this constitutes such a thing, but I'll let others discuss it. In the meantime, I'll edit that paragraph to more clearly state its purpose. – Sonic the Masked Werehog Sep 8 at 11:28
  • 1
  • Dedicated robo-reviewers have even easier tells than the number of answers being zero. A quick glance at the network tab reveals so. – John Dvorak 32 mins ago
  • @JohnDvorak What is network tab? – technastic_tc 30 mins ago
  • network tab of the developer tools in (firefox|chrome) – John Dvorak 14 mins ago

You must log in to answer this question.

Browse other questions tagged .