48

I've noticed in the last couple of days that there have been a few occasions when there's been a sudden surge of questions in the SO "Reopen" review queue.

Normally there's either no questions at all to reopen or at most three or four, and that's still the case, except that for the last couple of days I've gone to the review page and seen about fifty-odd questions in the queue, where just moments before there had been none.

I've gone through the reviews and the questions themselves seem reasonably legitimate (including the occasional audit), so I'm not questioning that... it just seems odd that there would be so many more than usual all of a sudden, and that they'd all appear at once.

Anyone got any insights, or should I just chalk this down as "one of those things"?

  • 11
    The sudden influx may be due to a recent, unannounced change: now all edits to a closed question push a question into the reopen queue, not just edits by the asker. – Gilles Sep 6 '13 at 16:08
  • @Gilles Pretty sure that's what's going on, based on my experience using the queue that's accounting for a significant percentage of the items. – Servy Sep 6 '13 at 16:10
  • fair enough. I'll accept that as plausible. But any reason why they'd all suddenly appear in the queue at once? – Spudley Sep 6 '13 at 16:15
  • @Spudley since the feature hasn't been announced, I think we'll have to let a SE employee answer why they just appear, but best guess is there is a script that adds them to the queue, and it only runs every few minutes. – psubsee2003 Sep 6 '13 at 16:18
  • People go on editing binges, some that include a lot of closed questions, a lot more often then people go on reopen-binges. A lot of the items are people going around retagging, or doing other serial edits. – Servy Sep 6 '13 at 16:21
  • yeah, fair enough I guess. (that said, @Servy, I'm really not convinced that a retag should be sufficient to trigger it into the reopen queue!) – Spudley Sep 6 '13 at 16:24
  • @Servy Only edits made during the first 5 days push a question into the reopen queue. (That's the one thing that changes between on-hold and closed.) Thus clean-up mass edits that affect a long-quiescent closed question won't make it more likely that the question is reopened (someone could cast the first vote outside the queue, obviously). – Gilles Sep 6 '13 at 16:26
  • @Spudley I agree, but having recently reviewed a whole string of retagged questions by a single user, I can assure you it currently is doing exactly that. – Servy Sep 6 '13 at 16:27
  • @Gilles Still, there are a lot of mass-edits by single users that hit enough recently closed questions. The reviews that I've done in the past few days have resulted in plenty of observational evidence of that. – Servy Sep 6 '13 at 16:28
71

We just rolled out a change to how questions are automatically added to the reopen queue. Previously, if the author edited a closed post within 5 days of it being closed, that would trigger it to be added to the queue. This was a great way to get additional views for questions that might've been improved enough to be re-opened, but it didn't do much for questions that 3rd-parties without the ability to vote for reopen think should be re-opened.

So rather than implementing some new boring impotent flag for this purpose, we decided to take other criteria into account, things that might indicate a closed question that could use some additional review. Currently, this means that a closed question will automatically be added to the reopen queue when it is...

  • ...Edited (body edits only) within 5 days of closure by the author. Or,
  • ...Edited (body edits only) within 5 days of closure by a 3rd-party, provided the editor has not also flagged the question or voted to close it. Or,
  • ...Sufficiently popular, where popularity is calculated based on question score, top answer score, or views per month. We're still tweaking the exact thresholds for these.

As always, a reopen vote will add a question to the reopen queue if it isn't already in the queue.

  • 1
    heh, so my guesstimate of "fifty-odd" was spot on... who'd have thought it? :-) – Spudley Sep 6 '13 at 16:26
  • 1
    Don't know whether the "closed in the past year" rule works as expected. We just got apple.stackexchange.com/questions/15586/… in the Reopen queue (and several more of about the same age). Not too big of a problem right now at least... – nohillside Sep 9 '13 at 14:38
  • That one was added due to the number of views, @patrix. – Shog9 Sep 9 '13 at 14:56
  • 1
    Fair point, maybe "duplicates" shouldn't score so high in general then bacause the topic itself is actively covered by another question already so the risk of them remaining buried is lower (compared to questions closed for other reasons) – nohillside Sep 9 '13 at 15:33
  • 1
    That's a fair point @patrix (although I have seen some incorrectly-closed duplicates crop up). Feature-request... – Shog9 Sep 9 '13 at 15:37
  • 2
    Maybe you guys could remove the Revision tab on these when there's no actual revision... A bit misleading. It confused me a lot at first. "Why are there so many revision-less revised questions?" – animuson Sep 9 '13 at 15:41
  • 3
    Could this be taught to ignore retags, whitespace edits, capitalization edits, and removal of salutation lines? – Manishearth Sep 9 '13 at 16:04
  • It already ignores retags, @Manishearth - "(body edits only)". Trying to differentiate between a significant and an insignificant body edit is beyond the capability of the system. – Shog9 Sep 9 '13 at 16:06
  • 1
    @Shog9 Over on SA, we only have about 13 10k users, and not all of those are active. Suggest smaller sites get tuned to no more than say 5 auto-reevalutes per day to reduce the burden. Also, they don't seem to be worth reopening almost ever, judging by the 20 from yesterday over on SA. Maybe the criteria can be tuned. – SAJ14SAJ Sep 10 '13 at 14:03
  • 1
    Does flag also include a reopen vote? – Shafik Yaghmour Feb 21 '14 at 15:13
  • 1
    Yes, @ShafikYaghmour - but a reopen vote will itself add the post to the queue. – Shog9 Feb 21 '14 at 16:32
  • 1
    Is the second of these (third-party edit so long as the editor didn't vote to close) still correct? As a moderator I will sometimes close a question immediately if I don't have time to fix it right then, and then come back some hours later to edit the question. I'd been assuming all along that my edits would send the question to the reopen queue. If not, how should moderators handle that case? – Monica Cellio Apr 25 '16 at 12:56
  • 3
    Moderators should directly reopen questions they fix, @Monica. We don't vote to give people powerful tools so they can mess around creating work for other people. – Shog9 Apr 25 '16 at 17:16
  • 1
    That's not quite true either, @E.P. - an accurate description would be, "a new reopen vote will create a review task if there are no active reopen votes or review tasks for the post". – Shog9 Jul 12 '16 at 23:20

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .