14

I just posted to our blog about our Third Quarter Community Roadmap for 2020.

Q3 2020 Community Roadmap. For July: "Community at our Center": Training Launch and New Moderator Agreement. "Community Builders": Review Queue: Reviewer Suspend Experience. "Inclusion": Downvotes Research. For August: "Community at our Center": Moderator Quarterly Survey and Lavender Letter Follow Up. "Community Builders": SME Content Strategy. "Inclusion": Reactions Test Analysis. "Grow & Scale: Internationalization - Discovery and Election Automation - Discovery. "Connecting Users to Opportunity": Interaction Modeling/Engaged User Satisfaction. "General Improvements": New Editor. For September: "Community at our Center": Moderator Council: Governance. "Community Builders": SME Content Release. "Inclusion": Moderator D&I Training and New User Email Series v2. "Grow & Scale": Teachers' Lounge Moderation and Tools for Community Managers. "Connecting Users to Opportunity": Area 51: The Way Forward - Discovery. "General Improvements": GDPR Consent Management v2.

Please see the post for details on the projects that our Community and Public Platform teams aim to work on this quarter.

We are interested in your thoughts and questions regarding our upcoming projects and priorities on the roadmap.

  • 18
    I find SME quite a confusing abbreviation here. You use it as Subject Matter Experts, to me it stands for Small- & Medium-sized Enterprises, which I guess it also stands for for a lot of people. Perhaps you can find a more clear cut term to use? – Luuklag Jul 23 at 19:35
  • 11
    Also coming back to these Subject Matter Experts, I heard that 2 extremely knowledge people on this subject were let go not too long ago from SE.inc. How is their collective wisdom on building strong communities maintained within the company? – Luuklag Jul 23 at 20:25
  • 2
    When we are at diversity and inclusivity, this years survey results insights.stackoverflow.com/survey/2020 use dark theme. Some people (me included) cannot read dark themes – Resistance Is Futile Jul 24 at 9:03
  • 9
    Thanks everyone for your feedback on accessibility. The alt attribute is now set here, and the blog has been updated to show an html table instead of the graphic, and to label each initiative in the text of the post with its month. – Yaakov Ellis Jul 24 at 11:49
39

Update: Y'all should really be looking at how GitHub does this: https://github.com/github/roadmap

Just a brilliant bit of information design. Each task follows a consistent format:

  1. Summary - a succinct, clear description of the task.
  2. Intended Outcome - the expected result of the task's successful completion.
  3. How will it work? - a detailed description of what the task involves.

Textual and visual metadata is then used to indicate the progress of each task and what it pertains to. The resulting roadmap can be quickly scanned and parsed for relevant information. I cannot recommend this highly enough!

Original answer

Nineteen tasks for this quarter, eh? That's... Ambitious...

I published my thoughts on the last two quarters' tasks a bit ago, and while they sparked some good discussion at least one person got pretty salty about some of the assumptions I'd made about the nature of the tasks. So in the interest of transparency, I figured I'd post my assumptions up front this time.

Notes on and assumed purpose of the 2020 3rd quarter roadmap tasks

This is how I've interpreted the tasks laid out for the current quarter:

Training Launch (Platform / Conflict resolution course)

An employee clarified in the comments that this was completed earlier this month.

Assumed test for success: Platform is re-used for D&I stuff mentioned in later task.

Moderator Quarterly Survey

Hooray! Please publish results. Surveys are like the Doomsday Machine in that Dr. Strangelove movie: they're only effective if folks know about them. I've seen what happens when you do regular surveys and don't publish the results or do anything in response to them: folks stop taking the survey.

Assumed test for success: results are published somewhere.

Moderator Council: Governance

This sounds useful. Also useful: giving them something useful to do.

Assumed test for success: moderator council figures out why they exist.

New Moderator Agreement

This is done-ish, unless too many moderators refuse to sign it. In which case, you'd better hope that the "Election Automation" task further down moves from "discovery" to "implementation" very quickly.

Assumed test for success: there are still enough moderators come September.

Lavender Letter Follow Up

Good. I'm epically tardy with responding to letters, but 10 months is impressive even to me.

Assumed test for success: a response emerges that isn't, "there will be a response".

Review Queue: Reviewer Suspend Experience

This is already underway!

Assumed test for success: fewer repeat suspensions, same number of people reviewing (or more), meta is not attacked by mobs of reviewers with torches and hay forks upset about their suspensions.

SME Content Strategy & Content Release

So... Subject matter experts are going to do something, somewhere?

Assumed test for success: subject matter experts do something, somewhere.

Downvotes Research

Another survey! Gonna just re-use what I wrote for the last one:

Hooray! Please publish results. Surveys are like the Doomsday Machine in that Dr. Strangelove movie: they're only effective if folks know about them. I've seen what happens when you do regular surveys and don't publish the results or do anything in response to them: folks stop taking the survey.

Assumed test for success: results are published somewhere.

Reactions Test Analysis

This is good. There was a LOT of feedback, both on meta and spread across the 'Net. Looking forward to an epic report here - don't forget that you can ask a dev to increase the maximum post length on meta!

Assumed test for success: a report is published that covers the outcome of the test in detail, summarizes all the responses, and lays out next steps.

Moderator D&I Training

This is a good idea. But... It was a good idea a year ago too - actually finding or creating useful training turned out to be much more difficult. A big part of the problem was that moderators don't stand to benefit much from the standard "D&I" courses that most new employees have to sit through these days (y'know. The ones where an animation slowly explains that fraud and harassment are bad, bad things) - what they actually need is the training that the folks giving D&I training get. And that turned out to be harder to line up than a Flash animation.

Assumed test for success: moderators report receiving training that is actually useful and relevant to what they do as moderators.

New User Email Series v2

The lessons of the last attempt here should be:

  1. Don't send people scary insulting emails
  2. Don't send people irrelevant emails

Those are... some pretty low bars to clear, but... They should've been the first time too.

Assumed test for success: nobody reports receiving irrelevant, insulting, or scary emails.

Internationalization - Discovery

I hope this means the international versions of Stack Overflow are going to get more support.

Assumed test for success: a new era of first-class support for languages and cultures other than English / Western. Failing that, Aki gets access to CM tools so that she can finally just edit the Japanese help center articles.

Election Automation - Discovery

I first asked for this in 2012. If it actually gets done before 2022, I'll cheer.

Assumed test for success: literally anything happens with election tooling.

Teachers Lounge Moderation Tools for Community Managers

I assume this means the TL is still sitting in that hack of a room I put together on MSE after certain people did the textual equivalent of throwing Molotov cocktails into the old TL, repeatedly, for weeks. Sad. I hate to say it, but this isn't going to work unless there are TL moderation tools for moderators as well - there are only four CMs left, and while they probably can still manage 24/7 coverage if need-be... It's sort of cruel to ask for that. It was pretty cruel already last year.

Assumed test for success: next time someone sets off a bomb in the TL, it doesn't burn for days.

Interaction Modeling / Engaged User Satisfaction

Complicated title for something that there's no description of. I am going to guess... Another survey?

My copypasta key is wearing out; please see notes under "Moderator Quarterly Survey" and "Downvotes Research".

Area 51: The Way Forward - Discovery

Big, if true.

Assumed test for success: any sort of plan or analysis of Area 51 is published. Ideally one that doesn't just badly reinvent something Robert proposed 6 years ago.

New Editor

Please, please, please just steal one from a site that already has a good Markdown editor. SO's editor was best-in-class 12 years ago, but it's been lapped many times now; heck, https://stackedit.io started with SO's editor and has long ago left it in the dust. Y'all don't have to try for something world-changing here, just aim for parity with what's already winning: take the one from GitHub, or StackEdit, or Visual Studio Code, or innumerable other places that've actually spent serious time making good editors over the past decade. Then use the time you save to beef up support for pasting in code - that's the big failure-scenario for new SO users.

P.S. Please don't steal Reddit's; it sucks.

Assumed test for success: an editor that rivals the one in Visual Studio Code. Or is the one in Visual Studio Code.

GDPR Consent Management v2

Well, that sounds vaguely ominous. But, legal things generally do.

Assumed test for success: Stack Overflow complies with all relevant European laws regarding the privacy and retention of personal information.


That's it! If there are errors or inaccuracies in any of the above, feel free to edit, or just post corrections to the blog.

| improve this answer | |
  • 3
    Re: Teachers Lounge Moderation Tools for Community Managers. We've not actually been given any info on this yet. But as far as I'm aware, the plan is still to go back to the old TL with revamped(?) tools and other less-well defined stuff. So my assumption is that the tools will refer to the old one. I hope they are not dumping time into "fixing" our temporary home. – Rubiksmoose Jul 23 at 21:05
  • Sounds like a safe assumption, @rubiks - that was the original plan, a temporary move for retooling. – Shog9 Jul 23 at 21:10
  • On the short term, unless something magnificent happens, is to get some RO's elected for TL, and let them run it. We just started talking about getting a whois bot up, so I'm indeed curious over what the big plan is :D. – Journeyman Geek Jul 23 at 21:13
  • 1
    Seeing you are one of the most E of the SME, are you going to be doing something, somewhere, sometime in the next 6-8 weeks? – Luuklag Jul 23 at 21:16
  • Was hoping to make more time for answering on SO... 🥺 – Shog9 Jul 23 at 21:17
  • 2
    "Assumed test for success: next time someone sets off a bomb in the TL, it doesn't burn for days." -- I hope this task perpetually gets an I for incomplete, because nobody tried to burn the place down again. (Or less optimistically -- that might not be a criteria that can be evaluated in the quarter the assignment is completed... might need another metric by which to judge success). – tpg2114 Jul 23 at 21:28
  • As with last quarter's reinstatement process, there will be tasks whose only fair test is their practical efficacy, @tpg2114. You could gin up something predicated on reception, but I got way too much grief about that for the reinstatement thing, so sticking with slightly more measurable criteria. – Shog9 Jul 23 at 21:38
  • 2
    @Shog9 It is summer. Ginning up sounds like a great idea... – Rubiksmoose Jul 23 at 21:40
  • 1
    With ya 100% there, @Rubiksmoose! – Shog9 Jul 23 at 21:40
  • 2
    Bring up homework questions, @tpg2114 - that's always a good time. – Shog9 Jul 23 at 21:41
  • 2
    The training that was launched was the Conflict Resolution training that Nicolas, JNat and I started working on back in November. It's been put up in a module on Thinkific. Mods can request access to it, take the lessons and get some help with SE-focused conflict resolution issues. Now that we have the platform in place, we're moving on to other subjects like the D&I training to support the Code of Conduct. – Catija Jul 23 at 21:45
  • 1
    "New User Email Series v2" test for success should probably be something measurable rather than a lack of something. I mean, "nobody reports receiving irrelevant, insulting, or scary emails" as the success criteria would make me think about not sending any emails as a solution... ;) – ColleenV Jul 23 at 21:45
  • 3
    I would accept that too, @ColleenV. Hippocratic oath success. – Shog9 Jul 23 at 22:03
  • 3
    "what they actually need is the training that the folks giving D&I training get" - Yes yes yes please. – Bryan Krause Jul 23 at 22:23
  • 2
    I'm using somewhat fanciful imagery to summarize a lot there, @Faded. The full story can be found here: meta.stackexchange.com/questions/337127/… – Shog9 Jul 24 at 15:55
27

The blog post implies that "Downvotes Research" is going to be limited to Stack Overflow here. I suspect you'll find very different results if you also start looking at the more subjective sites instead of just the technically oriented ones, and especially the sites which deal with more controversial topics (e.g. IPS, Politics or any of the religion sites). And that's not even getting into the whole "Voting is different on Meta" effect.

Also, will you be looking into how users feel after being downvoted, or are you just focusing on why users cast downvotes for now?

| improve this answer | |
  • 2
    This is a good question to ask – Pureferret Jul 23 at 18:22
  • 6
    If SE is going to look at how people feel after being downvoted... I hope they'll consider that feeling bad is not inherently a bad thing. We feel bad about things because these negative emotions teach us not to repeat a mistake. – S.L. Barth - Reinstate Monica Jul 24 at 11:59
  • 2
    @S.L.Barth-ReinstateMonica Agreed. However, one reason why I'm really concerned about the difference between "subjective" vs "technical" sites here is that there's a world of difference between feeling bad because you posted a technically wrong answer and feeling bad because you hold an unpopular opinion. – goldPseudo Jul 24 at 18:24
  • 4
    We especially need to distinguish between feeling bad because you posted a lazy unresearched post, and feeling bad because someone wrote an abusive comment (that needs to be deleted.) – curiousdannii Jul 25 at 2:56
24

A question after the alt stuff (and how Mith ended up doing it in the end) - you speak of inclusivity training. What areas in particular?

(The alt stuff, or rather, non-descriptive alt or info only available in low-qual pictures, hurts anybody with vision impairment. That's why it's important. If you're interested, I'm publishing an article about a11y/inclusivity in the field of gaming centered on a blind user tomorrow. Their perspective/take on what is available out there is more enlightening than reading about it through a third-party source)

| improve this answer | |
  • 6
    See also the last two times this happened: The May Loop and the January Loop. – Mithical Jul 23 at 17:06
  • 6
    Super interested, please share your article when it is published. We'll work to make this part of our launch checklist for these posts. – Sara Chipps Jul 23 at 17:30
  • @SaraChipps The article is more about how people found a way to interact with a closed UI with privileged elements than a UI/UX guide per se. It's still eye-opening, though. I'll give a link to Yaakov to relay to you so you can see it ahead of time :-) – Sébastien Renauld Jul 23 at 17:32
  • 1
    Thank you, sounds fascinating. – Sara Chipps Jul 23 at 17:39
  • 6
    Misuse of markup -- especially blockquotes -- is also a widespread issue in this realm. – jscs Jul 23 at 19:47
11

I'd just like to take the time to give a quick thank you to Yaakov and the team for a quick response to some of the concerns raised about this blog post.

In Discord, a concern was raised about how D&I training was mentioned for moderators, but there was no mention of that same training for staff. The blog post was edited to address this fairly quickly.

There was also the image alt text issue brought up in Seb's answer, which ended up with the alt text that I added here being put into the blog post itself.
Sara's comments about planning on doing better in the future were also appreciated.

So thanks for the quick responses and addressing the feedback!

| improve this answer | |
  • 1
    I wasn't that specific, but basically just saying the same: it is awesome to see how these folks are operating by now... – GhostCat Jul 23 at 18:53
  • Team effort on both sides! – Sébastien Renauld Jul 23 at 23:01
  • Thanks! Also, the graphic on the blog post has been replaced by an html table. – Yaakov Ellis Jul 24 at 12:13
11

Since I'm in the middle of trying to get some moderation in place on the moderator end of things, and rustling up some missing functionality - does this involve retrofitting moderation tools into the "legacy" TL, or enhancing the temp-permanent one on the MSE chat-server?

If it's the latter - would it be possible to take into account tools/abilities for TL Room Owners in the process?

If there's any secret squirrel stuff going on - I'm happy to move the conversation elsewhere.

| improve this answer | |
  • 5
    Definitely about going back to room four. The MSE room will stop being used once we get this stuff built. And, yes, the plan is to have mods moderating the room along with the CMs. – Catija Jul 23 at 21:41
10

Regarding the "Iterating on educational emails (September)" item, isn't it generally too late to tell a new user how the site works after they've signed up and asked their first question?

Hopefully, the new user has read the site's tour page, but that lacks some essential knowledge, such as emphasising that downvotes are not a personal attack, and that the user needs to tend to their question for perhaps a couple of hours after posting it, which could help with the previous item, "Downvotes research (July)."

| improve this answer | |
10

Some sites have asked to have their vote to close threshold lowered, from 5 to 3.

It's something that would be really nice, and while some CMs had access to do it in the past, now they do not. As it requires a dev to help our CM, could this be on the roadmap? It's maybe not a big item, but some sites are waiting for such change.

It's a change that was planned just before some CM firings, but now our remaining CMs have that task left in their hands

I ask, as I keep poking our CM for that in TL, but they have no dev time allowed for the task. It's not their fault, but if the item is not on the roadmap then that does not help them to get the resources to do it.

| improve this answer | |
  • 3
    For mods, I posted an update about this work back in June - while we do need some dev help for this, you're also correct that we need time to schedule it so that a CM can focus on tracking the tests and reviewing results. I have 12-15 sites that are already asking for a test like this but I have a feeling there are many who haven't asked who could benefit from it. This means going to those sites and letting them know about the test and getting feedback during and after to see if it's improving their experience. – Catija Jul 24 at 15:12
8

Your efforts are very much appreciated!

I find it extremely encouraging that you managed to get onto a path that seems to combine very different interests: On the one hand, the legitimate business need to attract users and paying customers. On the other hand, such core elements like improving moderation culture and tooling. And while diversity is still in, your plan acknowledges that "user happiness" also has a lot to do with "technical aspects should need to be logical and working"!

It is great to see how you folks kept course during this global crisis, and I am looking forward to participating with increasing frequency in the coming months, simply because you created an environment that invites your users to do so!

| improve this answer | |
5

Downvotes research (July)

Receiving downvotes on Stack Overflow can be a frustrating and confusing experience. We currently ask users to downvote posts that are not useful or are unclear, but this can be subjective and interpreted in different ways. We will run a short targeted onsite survey to better understand what motivates users to downvote a post and use this data to inform inclusion and engagement opportunities.

Whom do you plan to inform here?

From inclusion and engagement part it reads like you want to engage and inform users that downvote posts.

If that is true, I think you are missing main point. Downvotes are for poor and unsuitable content, they are cast because users asking questions (or posting answers) are not following site guidelines.

If you eliminate users that will not follow guidelines no matter what, what remains are users that were not properly informed about guidelines before posting. This is huge pain point, especially on Stack Overflow. You need to improve informing about guidelines and informing about consequences before users start writing their first posts.

| improve this answer | |
  • 2
    Let me share a now deleted Q/A on MSO about downvotes where I wrote an answer. It shows how hard it is to get users informed. – rene Jul 29 at 9:19
  • 3
    @rene I know. even people that follow those guidelines are completely misunderstanding some parts. Still, there is not enough being said about dovnvotes, close votes and their consequences. There should be three feet tall red sign saying if you post poor or unsuitable content you will be banned. But we have been told that is not friendly. – Resistance Is Futile Jul 29 at 9:23
  • 1
    There's now a discussion on this on Stackoverflow's Meta wherein many users seem to just have the view that SE will use this to justify some other change that removes our ability to moderate (giving the "thanks" stuff - this view is thoroughly justified IMO) – LinkBerest Jul 30 at 1:48

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .