When reviewing, it would be nice to see whether your Accept/Reject decisions are in line with the community's decisions. Specifically, I think the stats page should indicate the four signal detection theory quadrants:
- How many reviews did you mark Accept that were accepted? (hit)
- How many reviews did you mark Accept that were rejected? (false alarm)
- How many reviews did you mark Reject that were rejected? (correct rejection)
- How many reviews did you mark Reject that were accepted? (miss)
Perhaps clicking on the number might bring you to a list of those questions (e.g. for the second one, a list of questions that I accepted that others rejected).
Assuming that the community is correct, on average, then one could use this information to calculate d-prime (sensitivity) and beta (response bias). These are good metric to compare the quality of reviewers.
As is, you can review the history of your reviews, but tabulating this information would require clicking on every single link.