If the Community Evaluation review queue is only for beta sites to help determine if/when the site is ready for graduation (so it says in the answer to What are the review queues, and how do they work?) why has it suddenly appeared on Web Apps, which graduated from beta ages ago?

Is this a policy change or a technical glitch?

  • 2
    This is probably a glitch, but I think it'll be a good idea to run community evals on graduate sites (less often than betas, of course). – yannis Feb 2 '13 at 16:08
  • It's on Physics as well (Probably started Feb 1 UTC on both?). I've updated the faq to reflect this. I don't think it's a glitch, since there wasn't any statement denying that this happens. Aside from that, one of the sites the queue was tested on before it was rolled out was Ask Ubuntu, a graduated site. – Manishearth Feb 2 '13 at 16:14
  • 2
    Well, it does say "This review queue appears periodically on sites to evaluate the overall quality of the Q&A." Maintaining quality over time is just as important as starting off on the right foot. – Tim Stone Feb 2 '13 at 16:34
  • @Tim: Indeed, but this just appeared on two sites I frequent quite a bit and I'd never seen it before. (Or even heard of it, and I try to stay on top of things here on Meta.) What little information I could find when I went searching said it was for sites currently in beta. – ale Feb 2 '13 at 16:38
  • I believe it's a stand-in for these kind of manual evaluations. – Tim Stone Feb 2 '13 at 16:41
  • 1
    I think they're indirectly telling you that allowing Web Applications to graduate was a mistake ;) – Lorem Ipsum Feb 3 '13 at 6:04

This is new. Now that we no longer have to run site evaluations manually ourselves, we figured we would expand them to graduated sites.

Tim Stone hit the nail on the head in his comment:

Maintaining quality over time is just as important as starting off on the right foot.

Now, this is somewhat experimental. If these evaluations prove too distracting or not particularly helpful on graduated sites, we'll turn them off. In the meantime, the queue should pop up for a week every 90 days.

Update: after reviewing the results and responses across the network, we have disabled these evaluations for graduated sites. If specific communities want to do a periodic spot check of their own, we can fairly easily provide a random sample set of questions to them, but otherwise... y'all are "free and clear" once the beta period ends. :)

  • 3
    Feature request (should I post it separately?): don't do it for every site at once. For those of us who participate on several sites, it's a bit overwhelming. – Gilles 'SO- stop being evil' Feb 3 '13 at 19:39
  • @Gilles Don't worry about posting it separately. There's probably always going to be some overlap (we have a lot of sites), but I'll see what we can do. – Adam Lear Feb 3 '13 at 20:16
  • @Gilles If I recall correctly, there will always be several sites running simultaneously, but not all sites will run together. So, 5 sites might have evals going at any given time, but it'll be rare indeed if all 90+ have an eval running. – Aarthi Feb 4 '13 at 4:50
  • 3
    @Aarthi Aren't all non-trilogy sites having an eval right now? At least all the ones I participate on. – Gilles 'SO- stop being evil' Feb 4 '13 at 9:46
  • 1
    @Gilles Almost all. There are a few that aren't running right now for various reasons. We'll stagger future ones a bit better. – Adam Lear Feb 8 '13 at 17:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .