Which action could be taken to clean it up?
Based on my experience, this leads to substantial productivity gain.
- For example, I think it would make a perfect sense to introduce New bronze badge for using a filter on the Close Votes review queueNew bronze badge for using a filter on the Close Votes review queue to raise awareness of this feature.
Boring details on what led me to above conclusion are provided below; feel free to skip these.
Initially I've been going through close votes queue unfiltered. This worked just fine in all other queues I tried (dozen or two queues at SO and some smaller sites) and I saw no reasons to do it other way.
This queue felt a bit difficult from the beginning, but I thought I'll get used to it after a while. 300+ review actions passed, but it still felt cumbersome, at this moment I got curious why is that?
- Discomfort I felt when running through queue reminded me of old review system and of the reason why I didn't want to use it: items in queue were all too different and I just couldn't get into flow because of that. This naturally led me to idea to give filters a try.
My testing of filtering by close reasons began with "off topic". Bingo! Review went smooth and fast, and most important, I felt comfortable - just about like I felt with all other queues in new system. I tried "not constructive", then "not a real question" - great, the magic is there.
Testing "too localized" though didn't go so well. It felt cumbersome again - just the same feeling of having to deal with too many distractions. This lead me to idea to try filtering it further. I added a tag I was comfortable with and the magic flow was back again.
Based on my experience with "too localized", I switched to testing "duplicates" filtered by favorite tag from the very beginning. This worked well, too. Well, to be precise, duplicates review went slower (much slower) than the rest: I had to study both questions, and in some cases I also had to check the answers to both questions. But (and this is very big BUT) what is important, it felt really comfortable - as opposed to my prior experience with unfiltered queue.