15

For a while now we have had a filter for new questions that doesn't allow them to be posted until they pass a filter that checks for certain mistakes indicative of very low quality questions. Recently this filter has been altered to be more strict.

What is the goal of this filter? When users end up hitting this filter what are we expecting them to be doing?

For a small percentage of users they will be capable of just spending more time and effort on the question to fix enough of the issues to pass the filter. Personally I imagine that, by and large, if they were capable of writing a question good enough to pass the filter it's unlikely they would have hit it to begin with, so most of these users won't be capable of editing the question into appropriate shape on their own. Do others feel that a significant percentage of users will be able to edit the question into appropriate shape on their own. Note that some users in this position may find a way of bypassing the filter through some transformation without truly improving the question enough to be of even mediocre quality.

Some users will give up and not ask the question at all, since they cannot get past the filter on their own. Is this desirable? Are we assuming that these questions are of such low quality that they're better off being lost entirely? Do we really want these questions to just not be asked if they can't meet the filter, or is this case an unfortunate side effect of adding the filter?

Some users will seek help from outside the site, asking a friend, teacher, going to some other site, etc. to improve the grammar and other problems allowing them to post the question here without being blocked by the filter. Do we expect this to account for a noticeable percentage of users? Yes, if this happened it would be nice, as it's taking the burden of improving the lowest quality of questions off of our users, but can we expect a significant percentage of users to go through these steps?

Finally, other users will post on meta saying that they couldn't get past the filter and asking the meta community to improve their question. Is this desirable? Is this preferable to having these questions just not be blocked in the first place and just be posted on the main site and be edited into shape (or to have comments indicating how the OP should improve the question)? If this is preferable, how so; what is gained from such a meta question that wouldn't take place if the filter didn't exist?

16
  • We can help them once. If they don't learn then they will continued to be blocked, and we can refuse to help. I think the goal is to block those that are not willing to adapt to a new community. The content of the post ("what have you tried"), well, cannot be reliably detected with the filter, so I think it should not be the main purpose of the filter.
    – nhahtdh
    Commented May 3, 2013 at 15:38
  • 1
    @nhahtdh That sounds a lot like what the question ban does. If users post a lot of questions getting downvotes, closures, etc. they'll be question banned. If they're posting their questions on meta first every time to ensure it's edited into appropriate shape they won't be q-banned on the main site, even though they are effectively asking the exact same questions and putting in a comparable amount of effort. Do we expect the meta community to just stop helping people after they've asked for help once? Personally I don't see that happening.
    – Servy
    Commented May 3, 2013 at 15:41
  • 2
    I certainly agree that this seems like a new strain of the problem of low-quality content being channeled to meta. Commented May 3, 2013 at 15:44
  • @Servy Yes, but then we have to spend time downvoting and closing those questions. It's not about the individual users, because one shouldn't vote or close based on a user. It's solely for us, so we don't waste time with bad questions.
    – user206222
    Commented May 3, 2013 at 15:44
  • 1
    @BoltClock I understand what you mean, since there has been a rise in those questions on Meta, but I hardly think it's being channelled directly here as a whole. Previously, before the filter was strict, something like 4K blocks a day were made. We see maybe 1-3 of those a day.
    – user206222
    Commented May 3, 2013 at 15:47
  • You forgot the case of users who insert random crap into their question to circumvent the filter. (Which reminds me of the typical p0rbelms such filters introduce…)
    – slhck
    Commented May 3, 2013 at 16:01
  • @slhck What kind of random crap can they insert to bypass the low quality question filter? For the "problem" filter, sure, but I don't see what you could do in this case.
    – Servy
    Commented May 3, 2013 at 16:04
  • 1
    I ran a SE Data query out of curiosity, and it appears the low-quality question filter tweak on 4/17 didn't really affect the number of questions being asked (last two data points are the week of 4/15 and 4/22). Data.SE doesn't seem to go beyond 4/28 right now, so I only ran the query up to the last full week before then.
    – Rachel
    Commented May 3, 2013 at 16:04
  • 1
    @Servy: One example: skdlfasjekjfksjksdgjksdfjmsdkfjnqwkdfjwkhgovjesfojkfdsokjgkoldfjmgoerkjnvogjeokjfndosgjodksjgfokajgosdkjvkodfjgodkfjgkdfngfasljfowefjsdojfosk Commented May 3, 2013 at 16:08
  • @BoltClock'saUnicorn So adding that to the end of a question that doesn't pass the filter will make it pass the filter?
    – Servy
    Commented May 3, 2013 at 16:10
  • I'm not so sure the first category (people who actually realise they need to add more explanation/dump less code) is small enough to be negligible.
    – user200500
    Commented May 3, 2013 at 16:11
  • @Servy: Yes, apparently. I've had to edit that out of more than one post. Sometimes just editing it out works, other times it doesn't - apparently some quality blocks apply to edits and others don't. Commented May 3, 2013 at 16:13
  • 2
    I've seen quite a few <Inserted because filter wouldn't let me post this question>-like sentences. Can't dig out a specific example, but it exists.
    – slhck
    Commented May 3, 2013 at 16:16
  • @slhck Are you sure they're because of this filter though, and not say a meaningless code block to get through a JSFiddle link?
    – Servy
    Commented May 3, 2013 at 16:20
  • Yeah, those weren't related to JSFiddle at all – I also saw them on Super User, so this is probably an issue that's been around longer than the (new and improved) filter you are talking about.
    – slhck
    Commented May 3, 2013 at 16:27

2 Answers 2

2

I think the goal of the low quality filter is to:

  • Blocks garbage, i.e. nonsensical text. We don't waste time on people who don't need to ask question.
  • Blocks poor writing style, so as not to waste people's time to try to understand the post and edit it into shape. (e.g. i haz this prlbem i want code to do this and that and a long wall of text without punctuation plzz itz urgent thx)
  • Instruct people to format their code. (Or include their code into the question, in the case of jsfiddle)

Beyond this, I think it is outside the scope of the low quality filter, and into the community's (brutal) judgment. That is unless SE comes up with a filter that can analyze the meaning (semantic layer) of a post.

The role of the low quality filter is to reduce the community effort on tasks that can be automatically suggested to the poster. The automatic feedback needs improvement though; it is quite user-unfriendly, and does not suggest user what to do (I think give an extract of the FAQs is more user-friendly than just a red error message - people don't read FAQs).

I think it is OK to instruct user when they come to meta and ask for help with posting. If their post is craptastic or off-topic, we can save them from the shock of downvote and closure. If their content is good, but the presentation is a bit rusty, we can help them polish it a bit. I think it should be fine, as long as meta is not filled with these kind of requests everyday.

3
  • 1
    It seems to be blocking the most trivial of things though. Yes, it's unnatural not to capitalize "I", but is it egregious enough to warrant blocking the post entirely? I think that's the point Servy is trying to make (or at least one of the points). Commented May 3, 2013 at 16:31
  • 1
    If the purpose of the filter is to entirely block content of the lowest quality, so as to not waste the communities time, then why should we be spending the communities time to improve such a question if posted on meta? If we're doing that then the filter is failing at it's goal of preventing the community from wasting it's time (unless you're asserting that only a small number will bother to post on meta).
    – Servy
    Commented May 3, 2013 at 16:32
  • @Servy: My point is about the very poor writing style, which reads like English, but very hard to make sense out of. I think there is also problem with the feedback system, which is supposed to instruct user (automatically), but end up as just a simple wall to blockade them.
    – nhahtdh
    Commented May 3, 2013 at 16:39
2

The goal of this filter is to provide some automation of the winnowing of questions that have zero chance of attracting even a semi-intelligent answer.

If we are to require nothing for someone to post other than being able to fill a web form - then there will be thousands of people that take advantage of that low bar to post things.

I think we can all agree that we are all for a filter that prevents posts like this (with the title being the text before the - and the body after the -):

  • Q: Poop - What is is good for?
  • Q: iOS - I want to make an app - what do I do? HELP PLASE NOW
  • Q: EMACS or vi - Which is best for hadoop and go lang for making bespoke apps to attract VC dough?

The problem is that we don't have the data of all the thousands (millions) of failed attempts that didn't pass the filter, so most of us don't know how the filter works, what it does, what it's saving us from, what false positives are being thrown out with the poop. Since people are smart, those wanting to poop get better at pooping (especially since the filter is easily tested) and it's now time to implement some different approaches (or modified quality levels) to stem a very real quantity of very low quality information.

By saying no to some, we are saving more attention for measurably higher quality content.

I don't like filters, especially ones I didn't design, but I don't see a better option on the horizon than experimenting with tools to make the site better. From my interactions with the people that run the site, I would generalize that they are incredibly smart, aware of how their actions affect thousands of people daily, have the data to back up their decisions long before they make a code change and set up monitoring so that as the tool they designed interacts with the real world, they can and do check up on it to make sure it's actually working as intended.

On the flip side, there are some very terse questions that have provided some very awesome content for the site. Specifically, look over your site's greatest hits.

This list is filled with short, useful, detailed questions on all the original trilogy sites and whatever changes are being made will likely need to not have a high false-positive rate when it's fed a list of popular questions.

I would expect that as long as the filter doesn't shut down questions of similar quality to these examples above, no one would object to the system being overly restrictive or something that a new user would be incapable of rising to the occasion to rephrase their question to pass the entrance exam for a new question to be submitted.

Do you have some specific examples of questions you could not ask due to the new filter or are you looking for a discussion to share how they're doing it (it's robots and neural learning patterns, big data analytics and VC dough BTW)? I've not seen a dramatic down turn in the availability of high quality questions due to the filter, so I'm not sure we've turned the filter up high enough yet, personally.

6
  • I'm not so sure that the filter would actually stop the questions that you've posed, what with all of the upper case I's, proper spacing around punctuation, only a few misspelled words, appropriate grammar, etc.
    – Servy
    Commented May 3, 2013 at 16:17
  • @Servy There's also a length check.
    – user200500
    Commented May 3, 2013 at 16:18
  • @Asad I know there's a minimum character limit, but is the length check incorporated in the low quality filter check?
    – Servy
    Commented May 3, 2013 at 16:19
  • FYI you can get a decent idea of some of the questions that are blocked by looking around at the meta posts of "why wouldn't it let me ask <insert question quote here> because of the low quality filter?"
    – Servy
    Commented May 3, 2013 at 16:21
  • 1
    Also - I sidestepped the side question of whether people coming to meta to ask why X was closed. I think that's a sign that the system works. Meta is to get all that crap off the main site - so I think any changes that point people here to learn how the site works is a good change as well.
    – bmike
    Commented May 3, 2013 at 16:21
  • @Servy I can't be certain that it is the length that is causing it, but from some tests, really short questions give you the same error message as other low quality problems: "This post does not meet our quality standards." I made sure to use proper punctuation and capitalisation; even correct grammar.
    – user200500
    Commented May 3, 2013 at 16:23

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .