10

So I think all of us experienced overflowers and exchangers of stacks have learned that list questions are not considered good for the Q&A system the network is trying to achieve.

But when I want to clarify this point to new users, or on a new site, I can't seem to find a definitive place with clarification of arguments against them.

Is there somewhere in an FAQ, meta topic, blog, postcast, or statement from Joel or Jeff, etc, a "canonical" explanation of why list questions are bad?

(I wished to add some constructive violence on the linguistics.SE question "Which languages are used for purposes other than facilitating communication?")

8

2 Answers 2

14

For that specific question I'd go with the FAQ:

To prevent your question from being flagged and possibly removed, avoid asking subjective questions where …

  • every answer is equally valid: “What’s your favorite ______?”

But:

  • “What’s your favorite ______?” is silly.

Although the first part of that sentence, "every answer is equally valid", is the important one, (almost) every time I quote that part of the FAQ people rage that their question is not asking about what's everyone's favourite (It's just an example, people!). It's the most relevant documentation to quote (imho), it's not the most helpful, unfortunately.

The question in question does invite equally valid answers, and when that happens it's usually the popular and not the actually useful answer that floats at the top. Furthermore answers keep appearing ad nauseum, and the whole Q&A thread quickly degenerates into an unmaintainable pile of repetitive crap.

  • None of the above seems to be happening, though.

The question has generated three answers, and it was asked more than a month ago. Granted, I lack the expertise to judge whether the answers are actually useful, but they seem thorough enough, don't seem to be of the "what's your favourite" variety, and there isn't any information repetition.

My advice would be:

  • Add a post notice to the question

Moderators have a small set of canned official(ish) looking post notices they can add to any question or answer. The "insufficient explanation" one provides warning to future answerers of the type of answers the community expects:

We're looking for long answers that provide some explanation and context. Don't just give a one-line answer: please explain why you're recommending it as a solution. Answers that don't explain anything will be deleted. See Good Subjective, Bad Subjective for more information.

Typically we'd add a post notice after the first sign of trouble, not pro-actively, however sometimes it might help protect / salvage a good question that sits right on the fence of what works with the Q&A format and what doesn't. It's up to the linguistic mods to decide whether a post notice is justified or not, this is just a suggestion.

  • Forget about canonical sources.

The only canonical sources for the scope of Linguistics is the site's FAQ and Meta Linguistics. Yes, Stack Exchange in general doesn't like list questions. Stack Overflow closes them on sight and we kinda hate them on Programmers as well. But neither the Stack Overflow crowd nor our crowd are linguists, we have absolutely no idea about the subject matter. And I don't think anyone involved in writing the "subjective" blog posts in the Stack Exchange blog is a linguist either.

Who knows, list questions on linguistics might just work! If you feel they are detrimental to the site, make a case against them on Meta Linguistics and let the community decide. If you feel they could work with some extra protection, again Meta Linguistics would be the appropriate venue for the discussion. If you do decide to raise the issue on Meta, feel free to back up your arguments with any MSO discussion you can find or any SE blog post, I'm not saying that you or the Linguistics community should dismiss the collective experience, but you should decide if our past troubles apply to your subject matter on your own.

Most sites I'm active on seem to follow the general guidelines, and it might seem a waste of time to have a discussion that had been had countless times before only to reach the same conclusion. Well, there are a couple of sites that go completely against the flow and are doing just fine, Linguistics might just be one of the exceptions. Evaluate your questions that seem to go against the generic guidelines, and see for yourself if they have turn into a crapfest or not.

Lastly, and since no one has mentioned it yet, I find the Real Questions Have Answers blog post to be the more comprehensive on the matter, and I think the more useful quote is Aarobot conclusion:

real questions have answers, not items or ideas or opinions

The question in questions seems to have answers, and that's good enough for me.

8
  • Actually I didn't consider it scope, but guidelines. On travel.SE we've had it instilled in us that list questions are inherently bad here. But now I'm wondering where we got that idea from! Sep 24, 2012 at 6:00
  • 1
    @hippietrail I called the infamous "6SG" scope because they are engraved in every SE FAQ, but yes, guidelines might be more appropriate. Perhaps I've opened a big can of worms here, and I'll dread the moment this answer will be quoted on Programmers Meta on a discussion about a subjective question I closed seconds after it was asked, so I think I should point out that Programmers is a mature site, we have seen those questions fail again and again. Travel and Linguistics are still betas, you haven't seen them fail again and again for your subject matter.
    – yannis
    Sep 24, 2012 at 6:17
  • 1
    @hippietrail (cont...) The collective experience and the general guidelines are extremely important, and should not be dismissed. That said, your own subject matter and community are more important, and you shouldn't be held back by dogma. Do learn from everyone else, but don't follow blindly.
    – yannis
    Sep 24, 2012 at 6:19
  • Yes I'm just wondering if on travel we might have shifted the focus too much. I'm sure we thought we were following a rule followed on all sites whereas now it looks like we have almost invented our own private twin of the "bad subjective question" rule. In fact at travel we're about to graduate so it's a good time for us to look at our policies to see if anything is wrong that might need to be fixed. Sep 24, 2012 at 6:21
  • Yes very true. I'm just becoming wary of the possibility that we might have been unknowingly creating some dogma of our own too. With the help of the collective consciousness of all the SE sites we should be able to find the right balance. Maybe we already are balanced but it's worth some introspection. Sep 24, 2012 at 6:23
  • Also I don't want to misapply travel.SE dogmas to linguistics.SE which is younger, now that I know that our rules differ from the "network-wide" rules. Sep 24, 2012 at 6:24
  • 1
    One last thing that I think is very important for the bad rep list questions have: Bad list questions are amongst the crappiest questions one could ask, only a tiny bit better than the canonical crap "How is babby formed?". Furthermore on most sites bad list questions appear far more often than good list questions (good in the sense that there's evident prior research / effort). We can certainly afford losing a few good questions to protect ourselves from a ton of bad ones, but the ratio may differ per subject matter.
    – yannis
    Sep 24, 2012 at 6:34
  • 1
    I think we're lucky on travel.SE that we have so far had more good list questions than bad ones, and we do have some guidelines and principles such as "small closed lists are ok, open-ended lists are bad". But maybe we can hone it even better now. Sep 24, 2012 at 6:35
4

I see two problems that can occur with list questions.

  1. primarily opinion based
  2. too many possible answers

Questions that involve a list can overcome those problems when

  1. The question can be answered with a finite and complete list that is compiled from facts or references.
  2. OR The question clearly requires an overarching "How" or "Why" explanation beyond merely itemizing a list.

I am not a professional linguist, but it looks like the question linked to may have too many possible answers. Consider what could happen.

First answer contains items ABCDE
Second answer contains items FGHIJ
Third answer ... ACDFHI
Fourth answer ... ABEFIJKL
Fifth answer ... CDGHIJMNO

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .