What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 131 Stack Exchange communities.

Disclaimer: I've read Should downvotes on questions be "free"?, but I feel the landscape has changed in the last three years. What I'm looking for here is discussion about the results, looking back. I've included the best stats I could find, but if you have better numbers, please share.

Downvotes on questions are "free", while for answers it "costs" -1 rep. Making the question votes free was done, according to the linked post above, to encourage voting on questions, and as a way to filter the good content from the bad. These are fine ideas, but a few years later, I'm not sure it makes so much sense.

First, some numbers. I'm keeping this focused on Stack Overflow because that's where I'm most active, and I suspect smaller sites may not have the same issues.

Questions 

Total           6.673M
Upvotes        11.735M
Downvotes       1.039M
U/D Ratio      11.291
DV/Question     0.156

Answers 

Total          11.833M
Upvotes        25.929M
Downvotes       0.784M
U/D Ratio      33.081
DV/Answer       0.0663

We can all see that answers are still voted on more than questions, but this (IMO) is natural. What we can also see, though, is that questions are much more heavily downvoted than answers. If you post a question to SO, you have a 1/6 chance of being downvoted, while answers have a rate of 1/15.

Are the questions really that bad? Many would say they are, and this is natural. However, these numbers don't take into account deleted questions. Many "bad" questions are voted down, put on hold, then closed, then deleted. The deletion script in particular specifically looks for downvoted/closed questions to remove them. I feel that if we got the numbers including deletions, it would skew it even more.

Next, look at the Up/Down ratios. Back before question downvotes were free, the ratios were surprisingly even. Both questions and answers had a ratio of about 20:1. Now, questions are at 11:1 and answers are at 33:1. I believe this is direct result of one being free while the other costs rep, and I don't believe this is a change for the better.

In addition to everything so far, we have better tools to get rid of bad questions, and are lacking on answers. You can't put an answer on hold, you can only flag, downvote, delete. Many answers don't fall afoul of the flags, but are still bad. The only recourse here is to downvote, yet it's the only thing on the entire site that costs rep to do. Okay, bounties cost rep, too, but it's the only moderation-like tool that costs rep.

Another relevant topic is "piling on" downvotes, especially for new askers. Often a user wanders in, asks a not-quite-good question, and within ten minutes is staring at a -5 or lower score. Why? Because downvotes on questions are free. Yes, you see answers get downvoted quickly, but almost never as fast or as far. Why? Because they cost rep. Many users feel we should be more "friendly" to new users. I'm not sure where I sit on that, but I feel that in general, the "right" option is to put a question on hold, not downvote it into oblivion. The current system seems to encourage the latter.

Overall, I guess my question boils down to: Does it still make sense for question downvotes to be free?

Update

After restricting this to only the past year, the current ratios for upvotes to downvotes are 3.6:1 for questions and 27:1 for answers. This means the disparity between question/answer voting is wider than I initially thought.

share|improve this question
    
Are you accounting for deleted questions? –  Al E. Feb 18 at 19:50
    
No, I said as much in the post (I don't have those numbers). If you did count them, I feel it would only skew it even further, since most all of them would have downvotes. –  Geobits Feb 18 at 19:51
4  
Well, part of the point of downvotes on questions is so that the bad ones are auto-deleted. –  Al E. Feb 18 at 19:52
1  
What is the problem this would solve? It's not clear to me what issue this would address. –  Bart Feb 18 at 19:53
5  
-1 We have way too many bad questions as it is, your suggestion would only increase them. –  iStimple Feb 18 at 19:54
    
@Bart I think many users use a DV as a close-proxy, when in fact the question should be closed. It's free, so there's no reason not to DV or DV/close. when it should probably just be a close vote. –  Geobits Feb 18 at 19:55
2  
Still, what is the problem? If it should be closed, isn't it also "unclear or not useful" in most cases? Heck, there are even those who argue that a close vote without a downvote is out of the ordinary. –  Bart Feb 18 at 19:57
6  
@Geobits Because when I see trash, I put it in the appropriate bin. –  iStimple Feb 18 at 19:59
1  
So you better do your darndest to ask a good question, using the infinite amount of time you have before you post it @Geobits. All starts with a question. If that question is not good, it's far less likely to end up in something valuable than if a single answer is not all that great. So I don't particularly see a problem in a somewhat heavier burden. –  Bart Feb 18 at 20:11
1  
@Geobits People asking questions get their problem solved. The vast majority of questions would be asked even if there was no way for the asker to earn rep (and to be honest, the majority of those that are left are questions we'd rather not have here). There is some, but still less, intrinsic motivation for answering. People asking are asking to get a solution, people answering are frequently looking for recognition. –  Servy Feb 18 at 20:12
2  
The problem is, because of the unevenness, you can literally post half-ass, incomplete answers, confident you will gain a net positive reputation from it. –  Geobits Feb 18 at 20:14
2  
Here, play with this for a bit: data.stackexchange.com/stackoverflow/query/169006/… –  Shog9 Feb 18 at 20:28
1  
@JoeW No. A question might be well researched, well written, and useful, but still off topic, too broad, etc. Migrations are also closures (rejected ones remain on the source site, closed as off topic). –  Esoteric Screen Name Feb 18 at 20:45
4  
reading your analysis makes me feel that would be better for downvotes on answers to become free as well –  gnat Feb 18 at 21:11
1  
@gnat To be honest, I wasn't entirely sure which way to go with it. I had a feeling that neither would be met with much enthusiasm, but chose this way. Oh well, it's not my first heavily downvoted meta question :) –  Geobits Feb 18 at 21:15

2 Answers 2

up vote 16 down vote accepted

As I mentioned in comments, your data is wrong - and not just because deleted questions aren't included. But I'll get to that in a minute. First, you need to understand the problem this was trying to solve...

This site is full of crap, but there's no way to identify it

This was a huge, huge source of frustration back when free downvotes for questions were rolled out. People complained here on meta, viciously attacked new users on the main site, and flagged so many posts for moderator attention... But they didn't downvote them!

The team was working hard on automated systems to guide or outright block folks asking poor questions, but without any way to identify these "poor quality" questions these efforts were doomed. Something had to be done...

Along with free downvotes, there were several other changes made to assist with this identification:

These all helped, but I cannot overstate how big a problem this is. And here's problem #1 with the data you collected: you're ignoring questions that don't get any votes at all, which is the real problem these changes were intended to help mitigate. So here:

  • 2010-2011: 54% of questions didn't get any votes within 30 days of being asked.
  • 2013-2014: 62% of questions didn't get any votes within 30 days of being asked.

Yeah. The problem is actually getting worse. To a certain extent, that's unavoidable: the site is a lot bigger, the tail is a lot longer, and the chances of someone even seeing a given question aren't as good. But that's all the more reason to try and make sure we do as much as possible to encourage folks to vote when they do come across one.

People just don't downvote enough

The number you did get right is the ratio of up-votes to down-votes. It's pretty high, for both questions and answers. It's higher for answers, for various reasons (good and bad) that I won't go into here - but in both cases, folks overwhelmingly prefer up-voting over down-voting even when downvotes are free.

And that's ok... Up to a point.

In addition to everything so far, we have better tools to get rid of bad questions, and are lacking on answers.

We get rid of a lot of answers. But getting rid of things isn't really the point of down-voting - in many cases heavily downvoted posts should be deleted, but this isn't a given. More importantly, voting generates signal - for future readers, for the post's author, and for the system itself - as to what is good and helpful and what isn't.

Those tools for "getting rid" of questions? They're pretty heavy-duty; they require a lot of work from everyone involved. This is why I get so incredibly frustrated when folks talk about closing mediocre questions instead of down-voting them: imagine if your down-vote was held in limbo until 4 other people agreed with it - that's what closing amounts to. It's a way of getting questions that can't or shouldn't be answered off the site, not a "super-downvote" - indeed, a single close vote is very weak.

Which brings me to the data you requested: down-voting on deleted questions. No surprises there: it's higher than down-voting on other questions. Remember, closing is the precursor to deletion, and down-voting on closed questions finally reached the point where we were comfortable disabling those automatic downvotes I mentioned above, something I credit in large part to making down-votes free on questions.

So yes, we do need those. Because they're working. Horray!

share|improve this answer
1  
Unless I'm mistaken, the number "50% didn't get any votes" isn't right. On the linked queries, they're looking at different PostTypeId values. When I use your 2010-2011 query and change the date to the last year(getDate()-365), it shows that 62% of questions receive no votes now. If that's right, it means it's not an improvement at all –  Geobits Feb 18 at 22:22
    
You're right, @Geobits - I had the conclusions right on the first revision, just not the queries. Then I went to review them and ended up looking at the wrong queries! –  Shog9 Feb 18 at 22:25
1  
Gotcha. I will say that I wasn't ignoring unvoted-upon questions out of ignorance, I excluded them because the number of unvoted questions simply doesn't change the number of votes, or the ratio between up and down. I get that it was the problem that removing the penalty was designed to help, but I'm just not sure how much it's actually helping. Thanks for the numbers! –  Geobits Feb 18 at 22:28
1  
I've provided an updated chart over on this post as well - note that downvoted questions as a % of those closed was under 30% at the time of the change, which is pretty awful considering the sorts of stuff that gets closed. A lot of stuff depends on this. –  Shog9 Feb 18 at 22:40
    
Thanks. I think that paints a better picture of the downvoting and closing dynamic. –  Geobits Feb 18 at 22:46

I don't think "the numbers" can accurately answer this question, because the cost of down-voting a question has not been the only thing to change on this site in the years it has been in existence.

  1. The sheer number of users, and hence the number of questions in general, has skyrocketed.

  2. The number of low-quality questions - votes aside, just a subjective observation on my part - has also skyrocketed. I don't know whether the ratio of bad questions : good questions has grown symmetrically, but in the tags I frequent, it certainly seems to have out-paced the growth of new users.

  3. The rules of the site itself have changed quite a bit - open-ended and shopping list questions, for example, used to be okay, but now they get down-voted into oblivion (though arguably they should just be voted to close).

  4. The number of truly new questions has gone down considerably; the odds of asking a question that has already been asked has hockey-sticked upwards. Yet we still see a ton of questions that are asked without doing prior research, without paying attention to the duplicate suggestions or the related questions to the right, etc. These also tend to get heavily down-voted. And, arguably, rightfully so.

  5. Users who have been committed for a long time to the site have learned what types of answers are likely to get up-voted and down-voted. I suspect in certain tags a high percentage of answers are posted by a small percentage of users who know now not to post link-only answers, but may not have known as much a few years ago. (I look back on some of my own answers from years ago, and wonder how they ever earned any up-votes at all.) So this could also explain to some degree why a small percentage of answers get down-voted today in comparison to a few years ago.

  6. Flagging has also changed over time, and I think very few answers get down-voted when a flag would suffice. I'm not saying this is a good reason to flag an answer, but it is probably more common than even I want to admit. As a moderator on a low-volume site, I'm appalled at how many people use flags to alert moderators about answers that should be down-voted instead. Can't even imagine what it is like on SO. This definitely does not support any argument that down-voting questions should cost more, but rather that down-voting answers should cost less. (Or maybe even that flagging answers with certain flags should cost rep.)

A lot of these things have changed, and could in and of themselves explain an increase in down-vote ratios even without taking into consideration the change in how much a down-vote costs.

One thing that hasn't changed all that much is the ability to judge a question on its merits alone, without looking at the score or any flags / votes to close. Unfortunately, this is a very tedious and difficult thing to capture with numbers, unless you want to evaluate every single new question as it comes in and determine whether it deserves to be down-voted or not.

Without that information, I think it is impossible to know whether people down-vote answers far too freely now, or whether any change to the cost of down-votes will really have an impact - for the better - on users who post questions or answers that may or may not have been up-voted or down-voted before the change. There is almost certainly some truth to the theory that more down-votes occur on questions than would happen if they cost rep. But I think it is not feasible to determine how much impact that has, and whether making down-votes on questions cost would just lead to a far lower barrier to crap questions. I don't see many cases where questions are down-voted for no good reason, and I don't recall many questions where - if down-voting a question were to cost me 1 or 2 rep - I would not have still clicked the down arrow.

Is it really a bad thing that more questions are down-voted than answers? Maybe that really is a reflection of reality: that the ratio of bad:good questions is that bad. As I alluded to in a comment above, a lot of even the crappiest answers are still useful/helpful to someone. That is more than I can say for the majority of questions below my down-vote threshold.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .