What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 134 Stack Exchange communities.

I've heard bits and pieces from various sources, but I would really like to know, what does the Stack Exchange staff do to launch a new site? What are the milestones? I'm talking about Area 51 milestones, reviews to leave private and public beta, other reviews that might happen along the path during a public beta, etc. I'd just like to get an idea of what Stack Exchange Employees do when when it comes to launching a new site.

If possible, I would like to know approximate days of the week, site milestones, etc, with the understanding that things change based off of holidays and other special occasions.

share|improve this question
1  
I think that review #1 is at the start of commitment. Review #2 is 5-6 days into private beta, review #3 is there if private beta gets extended, and after public beta reviews are only there if the site is in trouble. In addition, staff members visit regularly for quick checks. –  Manishearth Oct 4 '13 at 13:41
    
@Manishearth: I've posted what I've been able to piece together. I think there's a few more reviews along the way, but I know there's more to it then that. –  PearsonArtPhoto Oct 4 '13 at 13:51
5  
Manish and Pearson both got it pretty much right, a bit more to it though. Grace Note is going to write up a nice somethin-or-other since it'd be nifty to have it somewhere we could point. –  Tim Post Oct 4 '13 at 14:11
    
I'd really like to see a blog post about this. –  aug Oct 9 '13 at 0:12

2 Answers 2

up vote 42 down vote accepted

This is a rundown the major milestones each site goes through from proposal through graduation. The process may vary from time to time as we improve the process or take on “special projects” as opportunities present themselves, but for the most part, this is the gist of it.

Area 51

  • Proposal SubmissionWhen a new site is proposed, we do a quick sanity check to find egregious problems, like overlapping scope or subjects that aren't well-suited to our Q&A format. But generally we’re okay to let a proposal develop before passing judgement.
  • Discussion and Comment — We don’t generally get involved the day-to-day discussions around an evolving proposal, unless someone is asking about the Area 51 process itself, or is seeking some policy input about the viability of a proposal. Communities are largely free to discuss and experiment at this stage without a lot of interference from us. But all the discussions (and example questions) are always reviewed and considered when when we do our “Final Review.”
  • Late-Stage Final ReviewWhen a proposal reaches about 40-50% commitment, we do a final review to make sure the proposal is healthy, well-presented, and everything is ready in preparation for the final launch. We’ll look over the example questions and the audience building the site to make sure it matches the proposal title and description. Often the title and description are consolidated to get rid of a lot of extraneous detail for use in the ‘help center’ once the site is created.
  • Site LaunchWhen a proposal hits 100% commitment, we do a final sanity check before we submit the site for launch into the private beta. Barring any technical or scheduling conflicts, private betas generally start 1-2 weeks after completion on either Tuesday or Wednesday. Anyone committed to the proposal will receive notification via email.

Private Beta

  • Early Moderation — Prior to appointing moderators from the community, the Stack Exchange Community Managers will take on the primary roles of site moderation. During the opening weeks, we will generally take care of any ‘flags’ and other urgent matters which cannot wait for the moderator appointees. During the private beta, there is also an increased sense of rigorous moderation while we prepare the site for opening day. If there is anything we can do to help set the community on track towards a stronger launch, the Community Team will take a more active role in community education.
  • Private Beta EvaluationAfter one week, we will evaluate how the private beta is doing. If the content looks strong and the community highly engaged, we will open the site to the public. If there are any problems (or the community simply needs more time to develop) we may extend a private beta out to a second week. But once the stage is set and everything looks good, it’s time to open the the doors to the public.
  • Proposal Reboot — On occasion, a community might not be able to get it together during the private beta. There may be nothing wrong with the subject itself. Perhaps we didn’t quite get the scope right, or the community just wasn’t well-equipped to pull it off. But whatever the case, sometimes we just have to close a private beta and (hopefully) send the idea back to the drawing board as a new proposal to try and get it right the second time around.

Public Beta

  • Appointing Pro Tem ModeratorsA few weeks after launch, we start the search for “pro tem moderators” who will watch over the site prior to the general elections (when the site graduates). This process may take awhile depending on how clearly candidates emerge from the early community, and how amenable they are to taking on that role. We try to appoint three candidates in the first round, but we may start with fewer and appoint the rest as soon as we can if the process drags on too long.
  • Moderator Review — Moderators are given special abilities to be the “exception handlers” to take care of situations that cannot easily be handled through the normal community process. But moderators are expected to agree to and abide by a Moderator Agreement which outlines their responsibilities and how they are expected to carry them out. Moderator actions are logged and user messaging is monitored to review how they are doing overall. It is very unusual to find any problems in this area, but when they do, the Community Team is here to advise.
  • On-going Community Self-Evaluations 90 days into the public beta, the system will solicit the first community self-evaluation, wherein the community will be asked to review ten recent, randomly-selected posts to see how they are performing relative to similar sites on the subject. The evaluation runs for about one week, at which time we will receive the results for review. We use this opportunity to evaluate every site more holistically, combining the participation in the self-evaluation with other metrics (e.g. traffic, user engagement, overall activity, moderation, meta involvement, etc). This cycle repeats every 180 days to track on-going progress and to be sure the site gets any attention it needs to help them build towards a successful graduation.
  • Graduation — Once a community reaches a tipping point where the quality remains high, the community is engaged and self-sustaining, and the traffic growth reaches a critical mass that assures continued success for the foreseeable future, we can start the process of graduation. This starts with our designer(s) who will start brainstorming custom designs for the site (watch the meta forum for announcements). It’s difficult to estimate the timeframe to complete this process. Designs vary and the workload varies, but input from the community is always appreciated.

Graduated Site

At this point the site is pretty much self-sustaining. The community becomes eligible for a few new features like creating a site blog, or creating their own “Community Promotion Ads” by submitting suggestions to the meta post by the same name. But the first order of business is to hold a general election where the community will replace (or re-elect) the provisional moderators with those elected by the community. Watch for the announcements starting about one month after graduation. After the first elections, we’ll generally check to see if new elections are needed about once per year. But elections can be held at any time, if additional help is needed. The Moderators are well equipped to watch over the site and let us know if there are any issues that need our attention. And there’s a lot of checks and analytics in place to let us know that everything is pretty much running on track.

share|improve this answer
3  
wow! thats indepth about the process +1 –  Sid Oct 11 '13 at 11:37
    
I've never seen such a "Community Self-Evaluations" in Programming Puzzles & Code Golf. Has that changed? Did I look at the wrong corner? –  Johannes Kuhn Oct 15 '13 at 15:14
3  
@Johannes We actually have Self-Evaluations disabled on both Code Golf and on Code Review. This is because the process consists of "Look for these questions elsewhere on the internet, and see how our answers compare against what is found out there", which is fine for the majority of sites. However, the nature of these two sites doesn't exactly make "Compare against other sites" a functional strategy to analyze the quality of the content there. For this reason, we disabled them. Our internal reviews look at several other metrics as mentioned, though, so those would still help. –  Grace Note Oct 16 '13 at 15:05
    
Thanks for that info. It's good to hear that both Programming Puzzles & Code Golf and Code Review are considered "special". The traffic, well, we have to advertise a bit. Questions? Wouldn't improve much, because writing good challenges is hard. –  Johannes Kuhn Oct 16 '13 at 15:40
    
Is this Private or Public Beta, I can only see "Beta": codereview.stackexchange.com –  Dmitri Zaitsev Dec 12 '13 at 4:28
    
@Dimitri It's public. A private Beta is only for the first week or two that a site exists, and it has select invite access (hence anyone who gets in during the private session will know it is private). –  Grace Note Dec 12 '13 at 5:56
    
Then I am puzzled why closure is only mentioned briefly and only for Private Beta, when it actually happens for active Public Beta sites. Are there any clear closure guidelines? I'd find it fair to give some peace of mind to people who invest their time in creating quality content and linking to it. Here is also my subjective opinion on the subject of closing. –  Dmitri Zaitsev Dec 17 '13 at 11:35
1  
@Dmitri There aren't any clear closing guidelines for public beta. Private Beta closures come as a result of insufficient performance during a small time period of less than a month. We don't have such an easy metric for public, as it more happens that we spend months looking into a site and trying everything we can to make sure it doesn't close. Think of three routes - a growing beta eventually graduates, a stagnant beta sits in beta, and a dying beta may close. What qualifies as dying rather depends on the site though, but largely starts from "not enough community backing." –  Grace Note Dec 17 '13 at 14:00
    
Then is there any clear warning to contributors that their contribution and reputation can be gone any time the decision makers come to the conclusion the site does perform enough? –  Dmitri Zaitsev Dec 17 '13 at 15:13
1  
@Dmitri We usually inform people when we think anything might be even remotely a concern, and from there it'll take months before things even come close to the chopping board, and from there if we do make a final decision we state as such in advance. Things can't just disappear at any time. –  Grace Note Dec 17 '13 at 15:17
    
What I mean is to state clear that there is always a risk the site gets closed, all links disappear and the whole content becomes only available as data dump. It is not fair only to inform people much later after they have contributed and relied on the site, when the actual concern occurs. I understand that it can easily occur should the site stop performing any time in the future. –  Dmitri Zaitsev Dec 17 '13 at 16:07

Here's what I've been able to piece together:

  1. There is a review about half way through the commitment phase (45%), where they get the name of the site settled, and otherwise prepare the ground to go. The most visible sign of this is that the title of the proposal is edited to its final name.
  2. There is a final review after it meets the commitment requirements, usually on a Monday. The site will then launch in the next day or two
  3. There is a review on the Monday in to private beta. If the site is progressing, it is made public, otherwise, it is given more time to find itself. If it passes the review, it will be made public within the next day.
  4. There is a review held at 90 days, which is a community self-evaluation.
  5. Presumably there is a review held periodically on sites at Stack Exchange, the details of which I don't know, to determine which sites are ready to launch, and which need some help.
share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .