Provide specific flagging examples to users new to /review:
- Concrete (anonymous?) examples of recent valid flagging by other users for non spam/offensive flags at least. Probably just another tab on /review.
- "Where are they now?" - longitudinal tracking of specific posts to see if other users flagged them. Basically a mechanism to say "I'm interested in learning what happens with this one", but without having to take a side in cases where you're not sure. Seeing how these borderline cases are handled will help users figure out whether or not to flag similar cases in the future. The implementation of this could be handled as a neutral flag, which causes it to be added to the flag weight summary page. It could also be used as a hint that the post ought to be weighted in order to be shown to more potential flaggers.
The feedback from flagging has improved a lot recently, but there still seems to be one aspect of it could be improved. Currently when using review there are four basic outcomes:
- Bad post, correctly flagged
- Good post, erroneously flagged (false positive)
- Good post, ignored or upvoted
- Bad post, ignored (false negative)
The current system seems to do well for all cases except for case 4. The current feedback on flagging encourages false negatives, particularly through the /review route (i.e. problem posts which don't get flagged.)
For case 1 you see what action the moderator took and get an increase in flag weight. Likewise for case 2, but with a decrease in weight.
Case 3 is the default, do-nothing behavior, the answer will probably get voted on by users and possibly accepted by the person who asked the question.
It seems though that the system as it stands positively encourages case 4 by penalizing flagging errors, which although reasonable to discourage excessive poor flagging encourages an "if in doubt don't flag" mentality.