14

If the Community Evaluation review queue is only for beta sites to help determine if/when the site is ready for graduation (so it says in the answer to What are the review queues, and how do they work?) why has it suddenly appeared on Web Apps, which graduated from beta ages ago?

Is this a policy change or a technical glitch?

Improve this question
6
  • 2
    This is probably a glitch, but I think it'll be a good idea to run community evals on graduate sites (less often than betas, of course).
    – yannis
    Feb 2, 2013 at 16:08
  • It's on Physics as well (Probably started Feb 1 UTC on both?). I've updated the faq to reflect this. I don't think it's a glitch, since there wasn't any statement denying that this happens. Aside from that, one of the sites the queue was tested on before it was rolled out was Ask Ubuntu, a graduated site.
    – Manishearth
    Feb 2, 2013 at 16:14
  • 3
    Well, it does say "This review queue appears periodically on sites to evaluate the overall quality of the Q&A." Maintaining quality over time is just as important as starting off on the right foot.
    – Tim Stone
    Feb 2, 2013 at 16:34
  • @Tim: Indeed, but this just appeared on two sites I frequent quite a bit and I'd never seen it before. (Or even heard of it, and I try to stay on top of things here on Meta.) What little information I could find when I went searching said it was for sites currently in beta.
    – ale
    Feb 2, 2013 at 16:38
  • 1
    I believe it's a stand-in for these kind of manual evaluations.
    – Tim Stone
    Feb 2, 2013 at 16:41
  • 1
    I think they're indirectly telling you that allowing Web Applications to graduate was a mistake ;)
    – Lorem Ipsum
    Feb 3, 2013 at 6:04

1 Answer 1

Reset to default
16

This is new. Now that we no longer have to run site evaluations manually ourselves, we figured we would expand them to graduated sites.

Tim Stone hit the nail on the head in his comment:

Maintaining quality over time is just as important as starting off on the right foot.

Now, this is somewhat experimental. If these evaluations prove too distracting or not particularly helpful on graduated sites, we'll turn them off. In the meantime, the queue should pop up for a week every 90 days.

Update: after reviewing the results and responses across the network, we have disabled these evaluations for graduated sites. If specific communities want to do a periodic spot check of their own, we can fairly easily provide a random sample set of questions to them, but otherwise... y'all are "free and clear" once the beta period ends. :)

Improve this answer
5
  • 3
    Feature request (should I post it separately?): don't do it for every site at once. For those of us who participate on several sites, it's a bit overwhelming.
    – Gilles 'SO- stop being evil'
    Feb 3, 2013 at 19:39
  • @Gilles Don't worry about posting it separately. There's probably always going to be some overlap (we have a lot of sites), but I'll see what we can do.
    – Adam Lear StaffMod
    Feb 3, 2013 at 20:16
  • @Gilles If I recall correctly, there will always be several sites running simultaneously, but not all sites will run together. So, 5 sites might have evals going at any given time, but it'll be rare indeed if all 90+ have an eval running.
    – Aarthi
    Feb 4, 2013 at 4:50
  • 3
    @Aarthi Aren't all non-trilogy sites having an eval right now? At least all the ones I participate on.
    – Gilles 'SO- stop being evil'
    Feb 4, 2013 at 9:46
  • 1
    @Gilles Almost all. There are a few that aren't running right now for various reasons. We'll stagger future ones a bit better.
    – Adam Lear StaffMod
    Feb 8, 2013 at 17:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .