The 10K tools are pretty cool... You get a birds-eye view of activity on the site, a "dashboard" view of what's happening. Some of the individual tools haven't scaled particularly well with Stack Overflow's growth, but the concept behind them is still sound: we trust you to enough to be a bee watcher now.
...and then there's the flag queue. What a let-down!
Once upon a time, this queue contained spam and offensive flags, which one might reasonably assume were important enough to put in front of the more trusted members of the site. Re-flagging them brought them that much closer to deletion, while editing them offered salvation to some hapless author.
Now days, it's a bunch of Not an Answer flags and a smattering of assorted cruft. 10K users can't even vote to delete these; only 20K users have that privilege. Re-flagging them does nothing but increase their priority in the moderator flag queue, where they frequently outrank more pressing issues; disputing them has its own issues. Also, it's full of bugs, and the behavior has diverged far enough from that of the moderator flag queue on which it is based that it has become an active hindrance to further development of the tooling there.
Worst of all, we have a much better tool for handling crap answers that's available to anyone with the editing privilege. It even has logic built in to prioritize answers likely to be deleted for users with the reputation to delete them. It's like we gave you a car for your 10th birthday, and then replaced it with a rusty bicycle when you turned 16.
It was a nice idea, but it has outlived its usefulness.
The /tools/flagged route goes away. Period. No replacement. The rest of the 10K tools stick around as informational pages.
Not an Answer flags go into /review/low-quality, just like Very Low Quality flags already do.
Then we beef up the Low Quality review process to make better use of more experienced reviewers and solve this whole "declined / helpful / disputed" flag debate once and for all:
- Effective # of reviews required == ReviewsRequired + # of applicable flags (where ReviewsRequired is 2 on Stack Overflow, 1 everywhere else). So 1 VLQ or NAA flag means
- LQ tasks are not dequeued until one of the following conditions is met:
- Post is edited from within review.
Outcome: flags are marked "helpful" (current behavior).
- Post accumulates 3 Delete votes (can only happen when post scores <= 0 and reviewers have >= 20K rep).
Outcome: post is deleted, flags are marked "helpful".
- Task accumulates
EffectiveReviewsRequired"Looks Good" reviews.
Outcome: if the number of (Recommend)Delete reviews is >= the number of Looks Good reviews, mark flags "disputed" and raise DisputedLowQuality mod flag. Otherwise, mark flags "declined".
- Task accumulates 6* RecommendDelete + Delete reviews.
Outcome: mark flags "helpful". If the post scores > 0 then raise DisputedLowQuality mod flag, else just delete post (current behavior).
- Post is edited from within review.
- As under the current system, flags on posts that've already completed one full review cycle without being deleted should skip /review and go directly into the mod queue.
- Flags get handled faster, more accurately, and with less wasted effort from 10K reviewers.
- Moderators are free to focus on situations that can't be handled by the community - the exceptional cases!
- Developers are free to make enhancements to the moderator tooling without having to work around 10K user restrictions.
Am I forgetting anything here? I haven't really spent much time in the 10K flag queue since back when it was filled with spam flags and therefore useful - is there a use-case that you depend on that would be lost with its removal? Post 'em below.
*: on Stack Overflow, only 4 Recommend Deletion reviews are sufficient.