Posted as a feature request:
Flag weight should be calculated in terms of % correct, not as though it were voting
Statistically speaking, the current system is broken.
If I get 51% of my flags correct, ultimately I will reach 500. Shouldn't someone who flags correctly 90% of the time have their flags shown in the list first?
Conversely, if I flag 49% of the time I will reach 0. Shouldn't I be more highly ranked than someone who only flags correctly 10% of the time?
Why is it that someone who flags correctly 51% of the time gets to be at 500, while I'm stuck wallowing in the mud because I'm flagging correctly 49% of the time?
I'd rather have a system that uses a sliding window of, say, the last hundred flags. How many of those were acted upon? It would easily translate into a percentage, and be very easy for the user to understand how well they are currently flagging.
It's technically more difficult to implement than the current system, so an alternative system would have much the same effect, and should be easy to implement:
The higher the weight a user achieves, the less effect a good flag has on weight, and the more effect a bad flag has on weight, and vice versa.
So at 500 weight, good flags have no effect anyway, but a bad flag might drop the weight by twenty points or more. It would then take 10 good flags at two points each to get back up to five hundred. At the bottom, a single good flag will jump the user up by twenty points, and it would take ten bad flags to get them back to zero.
In the middle, each good and bad flag would be ten points up or down. In this way, users would tend to stay near the middle unless they had a better or worse than average flagging record, and if their average is under ninety percent, they won't be at 500.
It would be easier to implement than a sliding window, and it would still give a useful effect. One couldn't get to five hundred, then simply maintain a fifty percent average and stay at the top of the list.
A simple implementation:
A good flag: currentweight += ( 500 - currentweight ) / 25
A bad flag: currentweight -= currentweight / 25
Rounded up, so at four ninety nine you'll still get one point for a good flag to get you to five hundred, and vice versa.