49

Over time I realized a very annoying property of the Stack Overflow reputation system: Easy answers to popular question are rewarded with a lot more reputation points than actually great answers. In case anybody actually needs examples for this, here are two examples from my own profile:

This answer gained me 420 rep, I invested 2 minutes writing it, and it only was a wild guess.

This answer took me about an hour for the research and the math and gained me 40 rep.

Now I know that you are bound to get more rep for answers that are useful to more people, and I'd say that's fine. But the current situation is quite extreme: 30% of my reputation is from 5 of my 330 answers, and they are definitely far from being my best ones.

A final example that is not from my profile, but more extreme: Do you really think this answer is worth 40000 reputation?

My proposition to improve that situation would be to make the reputation gain from a single answer non-linear, maybe even have it capped at a certain point. I'm not sure on how that non-linear function should look exactly, and would leave good proposals for that to users with more experience than me.

Improve this question
7
  • 3
    Related: Revisiting the rep cap (yes, again)
    – Pekka
    Commented Oct 15, 2013 at 1:05
  • 5
    The rep cap ends up eating a lot of the rep of highly voted answers/questions, which address this to a point.
    – Servy
    Commented Oct 15, 2013 at 1:06
  • 3
    @Servy I disagree: It also guarantees that once you have a lot of popular answers that are steadily upvoted, writing new and great answers is rewarded not only with comparably little, but actually no reputation at all. I think that balances out any good it does regarding this problem.
    – Chronial
    Commented Oct 15, 2013 at 1:11
  • 5
    @Chronial Tell that to Jon Skeet. He's one of just a handful of people who actually consistantly hits the rep cap basically every single day. Very few people hit the rep cap more than just occasionally. He provides more valuable content than just about any other contributor, despite the fact that, for quite some time now, he could just walk away and hit the rep cap every single day. Clearly the people capable of hitting the rep cap regularly are people that aren't here just to earn rep.
    – Servy
    Commented Oct 15, 2013 at 1:20
  • 3
    @Servy I still don’t see how it helps the issue – I never hit the rep-cap with my “easy rep” answers, I only hit it when I spend a lot of time on SO during a single day.
    – Chronial
    Commented Oct 15, 2013 at 1:27
  • 2
    @Chronial Most questions that get a lot of votes don't get it as a steady trickle over time. Some do, but most of the really highly voted answers get posted on reddit or some other social networking site and get a ton of votes over a few hours/days, and then it trails off to nothing after that. The questions that both get a lot of votes and get it spread out over a long period of time account for a minuscule percentage of the questions on this site.
    – Servy
    Commented Oct 15, 2013 at 1:29
  • 4
    I generally try and answer niche, particularly not easy questions. Recently though, I had a go at a few "noob" questions and got much more reputation in one week than for the previous month - (at least) I believe that there's most certainly something to this effect occurring on SO.
    – Qantas 94 Heavy
    Commented Oct 15, 2013 at 2:38

5 Answers 5

Reset to default
28

As a counterpoint, I present my own most highly voted answers. Almost all of these took a lot of time to research and write, and most of my simpler answers fall way below these in terms of votes. My most highly voted answer turned into a multi-page tutorial for a class I taught.

Sure, there are many examples of simple, quick answers to popular questions that rack up a lot of votes, but in my experience detailed, useful answers have a very long tail when it comes to voting. I keep getting votes years after writing many of these.

Your proposed solution would also work against answers like this, which seems to contradict your core goals. Lengthy answers can get lots of votes, just maybe not as quickly as shorter ones to popular questions. Do you believe that I should not have received as many points as I did for my more detailed answers?

It's all unicorn points, anyways, and the only value they have is in directing behavior. Let's say we implement a per-answer reduction or cap on reputation gained. What behavior would that drive? Well, since you couldn't make a lot of reputation on a single answer, it would encourage people to shotgun as many answers as they could. It would discourage you from spending time to improve a single answer, since the reputation you could get from that would be limited. That seems like the exact behavior you're trying to fix.

Improve this answer
1
  • The counterpoint is not necessarily one weighing against the broader problem. Answers tend to attract positive responses if they look good on cursory inspection to casual visitors, but very few voters sincerely evaluate accuracy or originality. Many answers receive great praise, while sidestepping the essential reason for a question being given, including a variety of factual or conceptual errors, or simply regurgitating a widespread or orthodox view. Meanwhile, original thinking is often punished.
    – brainchild
    Commented Nov 16, 2022 at 15:58
12

All upvotes are counted equal. There are far more beginners than experts. So in any voting contest, the beginners can outvote the experts.

But there is no fundamental reason why all votes should be equal. SE is artificial, the rules of how it operates can be set up in any way that (it is hoped) will contribute to achieving its objectives. So why not give some up voters more weight, giving a +2 rather than a +1? They could be selected using some manner that suggests they are indeed experts. By having a high reputation, or a particular badge, perhaps. The gold and silver tag badges might be good choices, as those are tied to a particular area of expertise.

Improve this answer
2

It certainly would make more sense that each new upvote is proportionally worth less after certain thresholds.

For example something like this would help level out the playing field:

  • When the post has 0 upvotes, each new upvote is worth 5 reputation
  • When the post has 10 upvotes, each new upvote is worth 4 reputation
  • When the post has 100 upvotes, each new upvote is worth 3 reputation
  • When the post has 1000 upvotes, each new upvote is worth 2 reputation
Improve this answer
1
  • 1
    Yes, I have been thinking along these lines (although the numbers would be different).
    – Mark
    Commented Dec 12, 2020 at 2:11
1

I stumbled upon the same issue in my question Laziness is rewarded big time by the reputation system.

My proposition to salvage this is to score questions (and/or answers) by their difficulty or research effort. High-reputation users could classify questions as "noob", "beginner", "intermediate", "pro" and "expert", for example. The rep system than calculates your score with the upvotes times a factor of 1, 2, 5, 10, and 20, depending on the classification. That way, both the relevance of a question to a large audience, as well as the expert level that it is asked on would go into the rep score and increase the correlation between the score and the competence of the author.

Improve this answer
4
0

The problem is that a lot of highly upvoted posts are very high quality. There's not any reason why the authors of high-quality posts shouldn't gain the reputation. While there are some very popular questions that gain a ton of upvotes for popularity, there aren't enough to justify a big change to the reputation system. And anyway, there aren't very many posts with thousands of upvotes that were posted anytime recently. The majority of them were asked back when SO's rules were different, and questions like that might not be as well-received nowadays.

Improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .