It's not that I feel bitter when somebody else's answer is upvoted above my own, but it's when a user with a high rep answers a question and their answer seems to attract an immediate barrage of upvotes. Now I'm not saying that these votes are always unwarranted, but by simply observing this behavior, I think the system seems flawed.

The concept of reputation (or at least one of the concepts) is to give users a sense of trust in the reputed user's answers. But this should be trust, not blind faith. I know that this problem doesn't exist for every question asked on SO, but it's definitely present.

I'm sure this is a contentious question, as it might seem overly critical, but does anybody else agree with me and, if so, does anybody have any thoughts on how this problem could be alleviated? It's a great shame when a new or less active user's answer is stifled by the reputation-rich user's answer.

share|improve this question
    
Somewhat similar to meta.stackoverflow.com/questions/198 –  Jon Skeet Jun 29 '09 at 10:25
1  
I'd say it's pretty much identical to my question –  ChrisF Jun 29 '09 at 10:32
    
Indeed. I hadn't read that question, and didn't associate it's title with what I wanted to ask. I'll leave it here as it's seems subjective and more open-ended. –  Kieran Hall Jun 29 '09 at 10:32
    
I suggest you wait till the next cc dump, we will have the community wiki flag so we can answer this definitively with a sql query –  waffles Jun 29 '09 at 11:05
4  
i have just recently experienced this..and actually I do feel slightly bitter, because I took time to do some research and answer a question only to have someone else's answer be upvoted which was an hour after mine. stackoverflow.com/questions/1115281/array-initialization-in-f –  Stan R. Jul 12 '09 at 6:57
3  
@Stan - In your example CMS provides a single line solution, and a link to more information on the subject in general. Are you sure that your answer is better than his? I don't know enough about the particular topic, but if your answer is just as good, then it's likely that people are voting his up because they prefer his method. They aren't saying your method is bad (you have no downvotes) but for subjective topics where there are several solutions, people will upvote the method they prefer over the methods they avoid. –  Adam Davis Jan 21 '10 at 21:13
    
possible duplicate of Should there be anonymous answers (and questions)? –  ChrisF Jul 21 '11 at 13:07
add comment

13 Answers

I operated a second account for some time because I was curious to find out whether low-reputation users are really treated much differently than high-reputation users. (Don't worry, the sock puppet never even glanced at anything contributed by my main account.)

My - of course subjective - impressions from that were:

  • low-rep users get more scrutiny on their contributions. That scrutiny isn't always there for high-rep users - I have seen instances where blatantly incorrect contributions (either by me or other high-rep users) were blindly upvoted by the community.

  • if there are two identical contributions from a new and a veteran user, that of the veteran user is more likely to get upvoted.

However, I also found that

  • if you make mistakes, they usually get pointed out. Whether you're a high or a low reputation user doesn't matter. The only difference is that with a high rep user, people may check twice before they say something.

  • If you provide good content, you will gain upvotes, no matter how much reputation you have. Apart from the fact that high-rep users are more trusted, and viewed somewhat less critically, by the community, there is no discrimination against lower-reputation users.

I dare say that overall, the voting system works fairly. If you are competent and able to express your knowledge in an understandable way, there are fine chances of succeeding on Stack Overflow, no matter how big the "establishment" of veteran high-rep users is.

share|improve this answer
1  
+1 for experiment. I'd happily see more of these, if possible backed by samples for each points, especially 2 (the new user coming with a slightly better answer, but the veteran getting a bit more upvotes, posting times being equal/averaged) and 4 (similarly obscure questions/answers (dupes would be perfect, but…), where both newcomer and veteran get their share of upvotes because of interesting insights). –  Nikana Reklawyks Nov 19 '12 at 6:23
1  
I view answers from high-rep users way more critical than those from low-rep users. I expect another level of quality from an e.g 20k+ user than from a 1k- user. While i would upvote a correct but not high-quality answer from a LR (it should be a good answer though) i would not do so for a HR. And while i would'nt downvote a quick and dirty answer from a LR/MR, i would downvote one from a HR. –  C5H8NNaO4 Oct 14 '13 at 13:18
    
there is no discrimination against lower-reputation users. To me, that seems like you consider that "people being more critical of low-rep users" is not important in the grand scheme of things. I think that this sort of thing is precisely what is important about this whole issue -- that there is a somewhat unfair treatment of users based on their reputation. –  Qantas 94 Heavy Feb 6 at 11:06
add comment

I didn't say I upvoted them, I just said that I assumed they were correct. :) – Robert Harvey Jan 21 at 23:28

There is a difference in trust in an answer (because you have the knowledge to say something about it), and trust in an answer (because it is explained well, and the author is trustworthy). The StackExchange reputation mechanism does not distinguish between the two, and therefore it cannot be told what prevails and how a certain reputation is constituted. I do not think it is a big problem, but it is quite interesting what happens when for instance a user does not see the reputation of a person (who gives an answer) until he votes for an answer. That is one way to test it.

Another way to test this is by sending 3 groups of 50 persons an email with a question and two answers. For all groups, the question and answers are the same. Each person must choose the better answer.

  • Group 1 gets a question and two answers. The author of answer A has a high (artificial) reputation. The author of answer B a low reputation.
  • Group 2 idem, but other way around.
  • Group C idem, but without the reputation of the authors included.

The persons have to be familiar with the reputation system, otherwise the reputation does not make sense to them. There are different ways to extend such an experiment: showing/not showing the votes for an answer, looking at the reputation of the persons and see if there are correlations between own reputation and trust in another reputation, etc.

I have also thought of another, similar approach to testing the influence of accumulated reputation and the trust it seems to convey. Show a video to the 3 groups and ask them to rate the video. The first group is not shown a rating, the second group is shown an average high rating of the video, and the third group is shown an average low rating in the video. What you try to decipher here, is how much an existing reputation/rating influences choice, trust, and perceived value. A video is not the same as a person, clearly, but I think the same internal mechanics play a role here (I’m not a psychologist.. anyone?).

The underlying assumption is of course that people are guided by other people, preferably exemplary people (or icons), and that the trust in SO-metrics allow for ‘not having to think myself’, hence consuming less energy and is therefore a preferred strategy for many people in such communities. There is of course nothing wrong with this, but it of course puts some requirements on the reputation system: the reputation people trust in must not be able to predict the behaviour of an reputed agent, at least when the agent has a high reputation. It means: I value my high reputation > I have been willing, and will be willing to put effort in finding answers that are valuable > therefore my intention is right. Even though intention does not equal quality of the answer, it comes quite close, because wrong/bad answers will degrade your reputation.

share|improve this answer
1  
I'm sure I posted something similar to this - but maybe I just thought about it ;) –  ChrisF Feb 19 '10 at 10:46
    
could be, I'm new here on this community, so I haven't seen all the relating discussions and arguments. –  user143526 Feb 19 '10 at 16:34
    
I agree with you! Lets get some real hard facts. –  user135501 Mar 19 '10 at 19:28
add comment

Does High Reputation Attract Too Many ‘Up-Votes’?

Correlation does not imply causation.

I think you are simply looking at things in reverse:

The correct question is

How did they get such a high rep in the first place?

You'll find that those with high rep answer quickly, legibly, understand the problem, explain themselves well, and in general provide very, very good answers.

So while you might think that two answers are the same from your perspective, the one with a slightly more accessible phrasing has an immediate edge over the one that while technically correct isn't worded as well.

But if you provide some examples of answers where the reputation was the only difference, then we might be able to quantify the effect better. In the past (this is not the first time this question has come up) most examples could readily be torn apart and shown that the votes really did fall to the more deserving answers, apart from the person posting.

share|improve this answer
19  
Generally speaking this is true. Occasionally I've seen an OK answer from a high-rep user win over a good answer from a low-rep user. It tends to be questions on niche (and untrendy) technologies, where the low-rep user has better knowledge on that specific area. I'm guessing the high-rep user is getting upvotes from other similarly-minded people who are also ignorant of some specific details of the niche technology. –  MarkJ Feb 19 '10 at 11:17
4  
See: any answer from Jeff Atwood. (And that's no jab at Jeff. It's a pretty remarkable effect, from what I've seen, though.) –  D_N Mar 7 '10 at 6:33
2  
@D_N - I'm not sure that's a good example. He doesn't post often (too busy building the site, I suspect) so he only posts when he has a great answer, and no one else has given a good answer. I know on Meta he gets lots of votes, but that's because he has a significantly more important opinion on meta topics. –  Adam Davis Mar 8 '10 at 1:46
2  
I believe you are avoiding the question "Does High Reputation Attract Too Many ‘Up-Votes’?" by stating a different question that is "How did they get such a high rep in the first place?". You should also say that the correlation can imply causation. I think the point of this discussion is to gain statistics from the phenomena and analyze when and why it can happen. –  user135501 Mar 19 '10 at 19:16
    
@partial - how do you suggest we go about determining whether this is true or not? All this question does is suggest we discuss the possibilities, but I don't see an easy way to test the theory. I do have a lot of data that shows that people who commit a lot of time to SO and are competent programmers get a lot of rep. Notice that they had to get the rep first before they had a high rep to possibly get this effect. Notice also that there are people who joined later who also get a lot of rep. We know that good people get rep. No one has yet shown that high rep gets rep. –  Adam Davis Mar 19 '10 at 19:31
1  
@Pollyanna: Thieme Hennis suggested a way of testing it. Do you know personally everyone in the community and know how good they are in every single programming language and technology there is out there? You know so much! –  user135501 Mar 19 '10 at 19:40
    
@partial - Great, test it and come back with data. I'm more than happy to eat my words, but at the moment the data we do have only points towards the conclusion I've come to. –  Adam Davis Mar 19 '10 at 20:08
1  
@Pollyanna: I fail to see how we have a conclusion here. Your logic is flawed has it is impossible to gain a conclusion without acknowledging or searching all the data possible that it be in favor or against the subject. Of course, the incomplete data can point to anything for the moment. Even if I would do certain tests the results would not mean anything has they would be unverifiable. I do not have the means to gain data on my own on such a great scale. I suggest the moderators or users with high enough reputation to have access to the moderation tools to do it. –  user135501 Mar 21 '10 at 20:48
    
You suggest that I should perform some tests but can you give statistical data on this : "You'll find that those with high rep answer quickly, legibly, understand the problem, explain themselves well, and in general provide very, very good answers."? –  user135501 Mar 21 '10 at 20:55
    
@partial - You suggest there's a problem, but you have no evidence. Why are you asking that the system be guilty until proven innocent? You have the power to run some tests your self - get or make an account with high reputation, and then post to both that and a low reputation account and see which one gains at a faster rate. It's not perfect, but it would at least give teeth to your argument that there's a problem. Right now I see no evidence of a problem. –  Adam Davis Mar 22 '10 at 0:20
    
@partial - further, the examples I give here: meta.stackoverflow.com/questions/43104/… demonstrate conclusively that it's as easy to get rep at lower levels than it is at higher levels, and some results suggest it's easier at the beginning than when you have a higher rep. So yes, we have some small data that shows that this is not a problem. Yet no one has come up with any data that even suggests there's a possible problem! You can test it on a small scale, and I suggest you do so. –  Adam Davis Mar 22 '10 at 0:22
    
I think there are a lot of users (and I am one of them) having most of rep because answered to very similar questions (especially in C#, i find a lot of similar question about LINQ and Asp.NET data binding, instead of in Scala, for example). I think that similar questions should be closed asap or rep scores halved. –  onof Aug 5 '10 at 21:00
add comment

Maybe I'm just a nerd, but the title of this question immediately brought to mind Gravity Wells. It seems almost inevitable that if you get a lot of reputation, you will get even more upvotes. And those upvotes will increase with the increase of reputation.

That being said, we don't operate the same way the Universe does. Some users will downvote reputable users out of envy, or spite. So while I think there is a valid point in suggesting users upvote other users because of their impressive reputation, I think it's equally valid to suggest that those with large reputation experience the exact opposite too.

Jon Skeet, personal testimonies?

share|improve this answer
2  
Rep singularities :) –  kd304 Jul 13 '09 at 12:52
    
+1 Human interactions have human motivations. Some neat, some gullible, some...not neat. –  D_N Mar 7 '10 at 6:36
add comment

Maybe there's another way to look at this. Maybe the "problem" isn't the upvoting itself, maybe it's the idea that all upvotes are identical.

If reputation is a measure of the community's trust in someone, then the value of an endorsement of an answer should, logically, scale with reputation. Or to put it more simply, Jon Skeet upvoting someone has more meaning than if I do.

To take this to a more fully-fleshed system, you could argue that an upvote from someone with approximately the same rep as you is worth 10 points, as it is today. An upvote from someone with 1 rep might be worth a single point, while a Jon Skeet upvote could be worth significantly more (20? 50? 100? I hear that an upvote from Jon Skeet actually changes the correct answer to match what was posted...)

This may not change the actual upvoting, but may change the impact of it - presumably the drive-bys would be from more casual people, and so would have little impact on a reasonably-repped user. However, even a single upvote from a well-respected user could have significant impact.

Similarly, upvoting something is an endorsement of the answer. Perhaps future votes on that answer should reflect on the rep of the up/down-voter? So if you upvote something that then proceeds to get 100 downvotes, including the Mighty Downvote of Jon Skeet, then that's probably a sign of a lack of judgement on your part, and a rep hit may be appropriate. This may also encourage people to annotate answers in comments rather than writing a new, but basically identical answer that just modifies one small bit. This idea is (obviously) ripe with abuse potential, and would need to be thought out more fully.

share|improve this answer
add comment

I've experienced this a few times. One example that comes to mind is: http://stackoverflow.com/questions/2290382/message-queue-system/

Wyatt, Joel and I say essentially the same thing. In fact Joel and my post are nearly identical but Joel has +13/-0 while I have +4/-1.

Why is Joel's answer 10 (9) points more valuable than mine?

Why is Joel's answer 6 points more valuable than Wyatt's when he provides several options?

share|improve this answer
4  
Well your post is later than Joel's (by one minute). –  ChrisF Mar 7 '10 at 18:10
2  
Ya 33 seconds actually. Wyatt's is even later but is the accepted answer so the additional upvotes make sense. –  Cory Charlton Mar 7 '10 at 18:29
    
It helps actually putting the contents of your answer in the text of the response. I out-scored Wyatt here mainly for explaining more in the text (my answer communicates that it's already built-in as opposed to a component that must be installed). I outscored you partly by taking advantage of highlighting to stand out more, partly by getting my answer in faster, and partly by providing an (arguably) better link. People have limited votes and so only tend to vote for the first answer they see of a particular type. –  Joel Coehoorn Mar 7 '10 at 19:38
    
Also, see my longer answer below. –  Joel Coehoorn Mar 7 '10 at 20:04
2  
Joel's answer is definitely better than yours. You both offer the same technical solution, but you just say “perhaps this is good”, whereas Joel provides context (“use something else”, and “already built in” are important ideas here). Wyatt's answer is intermediate; it provides more links, and it contains one of the contextual elements (“use something that exists already”), but Joel's is more explicit. –  Gilles Jul 21 '11 at 14:02
add comment

First of all I have seen many many cases where a low reputation user got many upvotes for his great answer and often in the same question where the high rep users are sitting in the dust.

Secondly I kinda agree, but in a different sense. What seems to happen is when an answer gets 1-2 upvotes an is at the top of the list. The rest of the upvotes for that question seem to go for that answer in blind faith.

I have seen of course many many cases where a question has many upvoted answers and a late well done answer comes along and blows the others away.

BTW I did a quick search for questions where this occurs (low rep users winning with good answers) And I found these in under about 2 minutes of searching.

551289 / 918865 / 1053705 / 1048643 / 934937

share|improve this answer
    
Hi Ólafur. I agree with what you're saying, especially in your second paragraph. I think one example of my point would be a simple question such as "What is Object Orientation?" A highly reputed user would attract many up-votes for simply linking to the Wikipedia article and this would be magnified by their answer being the first one. But I agree that this problem isn't exactly critical; it's just a bit of a bugbear of mine. –  Kieran Hall Jun 29 '09 at 10:51
add comment

I wonder what the ratio of such occasions are? The problem is, that there is no absolute 'oracle' person who could vote the good and medium and bad answers. Everything is relativized to the community, but the built in mechanisms to 'guide' the users to the optimum behavior seems to be inadequate. The SO site is a great place for socio-scientific research though.

There are tons of options available: make a bit harder to vote (e.g. move the vote option to the bottom-right of the answer), use floating point value between (-1 and 1) for voting. Use weighting system to compensate for high-rep/low-rep answers, randomize answer listing by default, move the accepted answer away from the top, etc.

With proper scientific analysis, things could be improved.

share|improve this answer
add comment

I think the problem is that people are too ready to upvote - full stop. An experienced SO user will typically get a well-presented (though maybe not technically correct) answer in before a less experienced user, and despite the proprietor's "coddle the newbs" attitude, these will tend to get the first few drive-by upvotes, which then escalate. I'm tempted to suggest a penalty for upvoting - maybe 1 point to upvote versus 5 to downvote?

share|improve this answer
    
YES YES YES. Charge for upvotes. –  AJ. Jan 21 '10 at 22:08
    
This is blasphemy! This is madness! –  Adam Davis Jan 21 '10 at 22:16
2  
Not really. Good advice must be worth something, and 1 point doesn't seem too expensive. –  nb69307 Jan 21 '10 at 22:25
    
If your premise is that people upvote quick answers to the detriment of answers that come in later, you should know that this is the way the founders designed the website. It's supposed to favor fast answers. I'm not saying that I believe this is ideal, but it is by design. –  Robert Harvey Jan 21 '10 at 23:27
1  
@Robert I realise that, and don't think it can or should be prevented - I'm anti the answer randomisation thing. But it does exacerbate the drive-by upvote problem - people upvoting without reading or understanding answers (or questions, come to that). –  nb69307 Jan 22 '10 at 8:56
    
@Pollyana THIS IS STACK OVERFLOW!!1! –  Andrew Grimm Mar 7 '10 at 22:52
add comment

There is a combination of factors here.

Remember, high rep users had to start at 1 like everyone else. They got there through consistently providing answers that are timely, accurate, well-written, and with follow-up. All five factors (consistency, speed, accuracy, prose, follow-up) are important. There are a lot of users that are good at two or three or even four of those, but I think you'll find that most first-pagers tend to do all five.

Accumulating a high rep makes surprising little difference in this system. You still post lots of answers, many of which are in early and of sufficiently high quality to earn a few upvotes regardless of who wrote them or when they arrived. Whenever this happens you have both a time and votes advantage, so no matter what sort option is used people see a good answer at the top of the list with already a few votes.

In this circumstance I freely acknowledge a "piling-on" effect, but I want to point two things:

  1. It's not necessarily bad any more. It's a good thing when one answer stands out from the crowd in terms of communicating to the asker and future readers what the solution to that problem is, and bad when you have several answers suggesting different approaches that all have about the same score. This is especially important when you have questions like "Should I do A or B?" and correct answer is "Neither, do C" or "How do I do A?" and the correct answer is "A is evil, never do that. Do B instead." Such answers need the credibility earned from a lot of votes. Since users have limited votes per day, it's common to only vote for one answer of a particular type, and so going with the most popular here is not a bad thing to do. That said, I consciously try to avoid voting for answers that seem to have attracted this effect.
  2. Being a high rep user has little to do with it. It's still about getting a good answer in fast. You may see high rep users benefit from this more often, but as I mentioned earlier it's mainly because they're good at those points. I've had plenty of answers ignored that I thought were as good or better because I was a little too slow on the keyboard. This is okay; one of Stack Overflow's best features is the speed with which you can normally attract a response to a question. It happens enough that I can now often recognize that situation and just delete mine in favor of the earlier response. There is a certain trust factor, though. High rep users might benefit from a few extra votes for their answers now and then when they've earned the trust of other viewers to a question. However, at such times this is both 1) trust that is first earned and 2) consistent with the way reputation is designed for Stack Overflow, that is, reputation is intended to gauge trust.

One final point is that for the really high rep users — those in the first column of the first page — high votes to an answer don't usually translate into high rep for answer. The user has either already hit the rep cap for the day or would soon anyway, even if the answer earned no votes at all. For I time I was in that group, and it was not uncommon to get enough votes to end that day at 400 or more if there had been no cap in place, even if my actual final score for the day was somewhere between 198 and 230.

share|improve this answer
add comment

I'd be interested in the following aspect of this question: does a high-reputation user attract traffic to a given question. I've seen questions of low importance with correct low-rep answers and hardly a vote at all. And I've seen similar questions with a correct high-rep answer and votes pouring in seconds afterwards. So it looks to me as if the fact that there was a high-rep answer attracted visitors and votes to the question. I wonder:

Do people prefer to read questions which had recent activity by a high-rep user?

If so, how would they know? One way would be looking at the page of recent answers in the user profile of e.g. Jon Skeet. If there are actually people who do so, it should be possible to obtain that information from the server logs: see which users followed a link from that page to a question and afterwards voted on one or more answers of that question.

Another way would be the attribution of activity in the listing of questions. I consider this the more likely route for users to take, and also harder to track. It would be interesting to omit that information for a day and see how that impacts votes for high-rep users, but I'm not sure you're willing to tamper with the system in this way just for the sake of gaining more insight here.

One mor way to tackle this might be some correlation between visits, votes and reputation. If people do not care about rep when reading questions (i.e. “No” to my statement above) but do prefer to up-vote high-rep answers (i.e. “Yes” to the statement from the question title), then the ratio of votes to visits should strongly correspond to the reputation. If, on the other hand, people were more interested in questions with high-rep activity, but still casting their votes on merit without considering the rep, then the effect should be far less dramatic, and only due to the better quality of high-rep answers. Not sure what numbers I'd expect for either case, though, so I'm not really happy with this approach.

share|improve this answer
add comment

I don't look at rep at all when I upvote, but I do confess that if Jon Skeet or Marc Gravell (really, anyone in the top ten) answer the question, I generally assume that their answer is correct without checking.

That said, the idea that people are upvoting high-rep users because they have high rep is highly speculative. Do you have proof that this is occurring? Maybe the high-rep users have high rep because they give better answers. I have nearly 30,000 rep on SO, and I can tell you that I'm pretty sure that I'm not favored at all when it comes to voting.

What is favored are the kinds of popular questions that get lots of views, where the answers are easily understandable. But I think that kind of low-hanging fruit is getting harder to find, what with duplicates, strict Community-Wiki policy and so forth.

share|improve this answer
2  
It would be really good if you didn't do that. Blindly upvoting (not singling out Jon or Marc here) is one of the banes of SO. –  nb69307 Jan 21 '10 at 21:05
3  
I didn't say I upvoted them, I just said that I assumed they were correct. :) –  Robert Harvey Jan 21 '10 at 23:28
add comment

In my experience, high reputation doesn't particularly attract upvotes. High reputation means lots of posts, not lots of votes per post.

You can look at some numbers on the data explorer. Let's look in particular at List of top users ranked by highest "Average Rep earned per Answer" and Top users by average answer score. The people with the highest-rated answers on average are not the people with the most reputation. These queries are not perfect (for example they use rep now, not rep when each vote was cast), but I think they do show that there isn't a strong bias towards upvoting high-reputation answers.

So the phenomenon you describe is nonexistent or marginal.

By the way, do not mistake better-worded answers with the same technical solution with identical answers. (I'm not saying you're making this mistake, but I have observed it; Cory Charlton is definitely making it.) Maybe the answerers who get more upvotes than you are equally good problem solvers but better writers. Or maybe they were just faster (especially in high-volume tags on Stack Overflow, speed is a big factor in getting upvotes).

share|improve this answer
add comment

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .