15

I'm not a big fan of the "problem" filter for titles. People have been discussing how to get around it. I think users with enough reputation should be able to use the word. Others think it should be removed entirely. If the first request was declined, then here's another one.

I know you're probably getting tired of it and decided to drop the science hammer on it. I'll do the same from a logical and statistical point of view.


The filter has been introduced on Sept. 28, at least that's when the last question with "problem" in the title was posted on Super User. Ever since then, I've seen people increasingly use synonyms to circumvent the filter, but leave the title ambiguous as-is.

That's my main issue there. If you just restrict the usage, people will either:

  • Write a good title instead.
  • Use a synonym and write an equally bad title (dubbed "benign").

Now you have a good outcome, which is nice, or you have a "benign" outcome. Still, this outcome is even worse than having "Problem" in the title. Because it can't be tracked. Before, every user could easily look for "Problem" and see where the problematic questions (…) were. We could issue a query that allowed us to look for bad posts. Now, we simply can't do that anymore, because the title might use a synonym or other bad wording.

I know the developers have a flag for a post that triggered the filter, but we reviewers don't see this. We can never find out which question triggered the filter, so we have to keep our fingers crossed that people actually write a better title, which they don't do, according to the "efficacy" stats. All these stats tell me is that we've now lost a way of finding bad quality content, because 62% of those title changes were "benign".


This is why it would make sense to just automatically flag posts that use "problem" in the title with the low quality flag, so they show up in the "low quality" queue, and in the flag queue. You could still restrict new users from using it, but because they triggered the filter, they'd get the automatic flag.

And now, to support this, here are some stats from Super User:

  • Jul. 15, 2009 → Sept. 28, 2011:
    410 questions with "issue" in the title. An average of 0.51 per day.

  • Sept. 28, 2011 → Dec. 09, 2011:
    64 questions with "issue" in the title. An average of 0.88 per day.

Do you see the significant increase here?

Update: As @sth has pointed out, of course this is also explained by a general traffic increase on the site. This is definitely important to consider, but here's another smaller time frame, not taking into account the two years before:

  • Jul. 1, 2011 → Sept. 28, 2011:
    56 questions with "issue" in the title. An average of 0.63 per day.

This is just one synonym I can think of. And these are just some simple stats. This is not the main point of this post. The main argument is: There are probably many other patterns of escaping the filter too, but I have no idea on how we editors/reviewers could track this.

Therefore, just flag failed attempts.

14
  • 3
    You have to divide those questions-per-day numbers by the average total number of questions per day in that time, else they might just represent a general increase in traffic.
    – sth
    Commented Dec 9, 2011 at 19:37
  • @sth While you are right, I've compared it to more recent time frames too, and there is a significant difference nonetheless. For example, the average between July 2011 and end of September 2011 is 0.62, a time range of roughly 89 days.
    – slhck
    Commented Dec 9, 2011 at 19:39
  • 1
    Also, this is just some idea, and by no means the main point of this request, which is about having an automatic flag for these posts.
    – slhck
    Commented Dec 9, 2011 at 19:44
  • 1
    Should be the same for questions with dupe titles IMO. Show the problem to those equipped to deal with it, rather than letting it be obscured. (In the case of dupe titles the original should probably be investigated as well as the new -- it's mostly bad titles that get duplicated.)
    – user154510
    Commented Dec 9, 2011 at 20:07
  • @Frédéric Hamidi just pointed out that the title should read "don't block". He's correct, isn't he?
    – Pekka
    Commented Dec 9, 2011 at 21:17
  • 1
    @Pekka Well. As long as they're not allowing it, they should at least flag those. I still stand by the request to allow it for users with enough reputation.
    – slhck
    Commented Dec 9, 2011 at 21:20
  • 1
    @slhck, how would we flag a question that was blocked? Now I'm even more confused. I'm sorry, it's Friday evening in my timezone, and I'm quite tired. Am I missing something? Commented Dec 9, 2011 at 21:24
  • @FrédéricHamidi In the "efficacy" report, Kevin took into account all questions that triggered the filter. These are questions by users who tried to include "problem" in the title, but failed due to the filter. What I'm talking about is auto-flagging those questions.
    – slhck
    Commented Dec 9, 2011 at 21:26
  • @slhck, oh, that's what I was missing. So you want to keep the filter and flag circumvention attempts? Commented Dec 9, 2011 at 21:48
  • @FrédéricHamidi I don't want to keep the filter at all, I'd get rid of it. But if they want to keep it they should at least auto-flag failed attempts.
    – slhck
    Commented Dec 9, 2011 at 21:49
  • @slhck, I said before that I [was] too young here to know the importance of the issue it was supposed to solve and how efficiently it ended up solving it, but Kevin's post looks right on the money. The filter indeed seems to be successful, because there is only a minority of users who will try to bypass it without improving their question's title. Sure, most of time (62%) their improvement is a simple workaround, but that still helps search. On the other hand, auto-flagging these 62% would add to the mod team's burden. We should ask them. Commented Dec 9, 2011 at 22:13
  • @FrédéricHamidi These 62% are not a positive improvement. It's just a change that you can't track anymore. How do you mean that it "helps search"?
    – slhck
    Commented Dec 9, 2011 at 22:16
  • @slhck, by helps search, I mean that, for instance, everyone who types windows help system or OpenGL texture problem on X11 into google can see the higher-quality questions about the winhelp system or OpenGL texturing on X11 first, instead of the myriads of questions that might have OpenGL problem or help windows in their title, if that was allowed. Commented Dec 9, 2011 at 22:36
  • @FrédéricHamidi: But what about "halting problem" and so on?
    – SamB
    Commented Feb 7, 2012 at 2:33

0

You must log in to answer this question.

Browse other questions tagged .