Upvoting based on celebrity, too many upvotes ("excessive rep slurping")

Question

I have noticed a couple of kinds of behavior that seem to crop up in the SO community, and it really seems to artificially boost reputation. There may not be a solution (or it may not be a problem!) but here are some thoughts.

The first is the fact that "celebrity" users, or users with lots of reputation, are treated significantly better than others. Take Joel Spolsky's most recent question:

"How do you move the turtle in LOGO?"

It was closed, opened, closed, and re-opened. And the question has earned Joel - what - 1030 reputation 103 votes, and lots of reputation! Wow! I'm not saying that Joel's question is a bad one. But lets compare to other questions that one might consider to be in the same equivalence class - easily answerable, specific questions, short questions:

How to export data from SQL Server 2005 to MySQL (5 votes)

How to use the C socket API in C++ on z/OS (5 votes)

If you look at the hightest-voted questions, I can hardly find any which are specific technical questions. So that Joel's question was so upvoted could only mean that:

1. It was upvoted based on his celebrity
2. People have been interpreting the questions as a sort of zen-like wakeup call, designed to get people talking and thinking about they way they vote.

I do not mean any disrespect toward Joel, and again, I think his question was a good one. This post isn't about Joel! But the boost in reputation did not (imho) mean "Joel is really good at programming, and he has earned my trust as someone knowledgeable about computers." It may be true that Joel is a proficient computer expert, but not based on the merit of that one question.

Which leads me to an example about myself. I recently gave this answer (130 reputation) to a question about PHP's image-creating libraries. I am very appreciative of the community's support for my answer - an answer which I believe was well-thought and that I put effort into.

At the same time I can't look someone and tell them, with a straight face, that my reputation is a great reflection of my computer-related knowledge. Billions of people on the net have created tutorials for PHP's GD image library - I just happened to be the person to post a few of them. Heck if I know why it got 13 votes! (oh, but please don't downvote it!!)

SO is built by the community - so the community absolutely gets to decide what questions are important, and how they choose to dispense reputation. But in practice, I feel like peoples' reputation would be much lower if the community were more discriminating about the way they voted.

So: am I totally off base here? Is this even something that can be corrected with a different reputation algorithm? Or am I the only one who sees this as a detriment to the SO community?

(And, to be completely clear, I do not intend for this to be an ad hominem, and I am not jealous about not having a higher reputation. But I do take reputation with a grain of salt, in part for these reasons, and I thought I'd bring it up! It is meta, after all!)

Answer 1

This doesn't seem to be any different than real life. If Steve Jobs says he has an idea for a new application, many more people will "notice" what he has to say than if I come up with the next best iPod killer.

<sarcasm>

All you have to do is become one of the leading software-industry commentators since the earliest days of blogging, co-found a web site that attracts 30-40% of the world's programmers, start a podcast that 1000's of people download weekly, make an off-comment plug for a post you are going to make...

...and you can have a few thousand extra "reputation points", too.

</sarcasm>

Answer 2

Your Stack Overflow reputation is a measurement of how much the system trusts you. It is not, nor was it ever intended as, a measurement of how good a programmer you are.

Answer 3

I've found that by answering tough or obscure questions, I'm lucky to get more than one vote, but by repeatedly answering the easy questions about IDisposable that are asked every day, I can make 220+ in a day pretty reliably - assuming I can find the time (and I get lucky with the timing of accepted questions).

Update: just answered "What's the value of yield return?" again - and have seen it asked and answered by others many, many times.

I think SO rep measures answers more than questions, because repeatedly asking easy questions appears to be quite hard to get away with - whenever someone starts asking 2 stupid questions per day, the community soon gets wise to this and downvotes them. I doubt if you can build up much rep by asking instead of answering.

So it's pretty clear to me that SO rep is nothing more than a measure of how a person likes to spend their spare time helping other people with programming problems.

Nothing to do with how smart they are, or how deep their knowledge goes... just where they focus their available time.

Answer 4

Don't get hung up on reputation. It's not real money or measure of self worth. It's only marginally better than certification.

Answer 5

I agree this is something of an issue. Or at least, it is a very good reason to not simply judge people based on the number of their rep. It happens every week with whatever question Joel and Jeff discuss on the podcast. However, I really expect that's nothing that can be done, other than being a wise consumer of the data presented by SO. Your rep is a number, based losely on "how much the system trusts you" and somewhat on "how good a programmer you are". And even, somewhat on "how good a writer you are". The key is, if you're trying to evaluate a user, look at more than just their number, look at how they achieved it.

I have even noticed it with my own reputation, as my rep has gotten higher, I've found it easier to get reputation. Part of that is likely because I've gotten better at clearly stating my opinion/answer. However, I certainly recognize that part of it is that basic psychology plays into how people vote and therefore, they are more likely to vote for an answer by someone who has established reputation.

Answer 6

It seems that some of you doubt this problem is more pervasive than the occasional question by Joel or Alan Kay. I just observed it yesterday.

Get every combination of strings

Now please note I am not picking on Alex. Everyone makes mistakes sometimes, but earning 40 rep while the correct answer had 0 votes on it after 1-2 hours with over 90 views is sad.

Answer 7

Of course guys like Jon Skeet attract more rep, because they already earned a lot (emphasize on "earned").
But don't make the exception (Joel asking about turtles) the rule. Joel is very famous in this community and the question was obviously simple. The question got popular because of this contrast. It make people think "What does Joel intend?". And they tried to show their respect.

Answer 8

In addition to being (sort of) a measure of programming skill and writing ability, reputation serves as a metric for how much time and effort you put into the community. Someone like Jon Skeet, who visits SO daily and continues to answer questions even after he's hit the daily cap, should have an enormous rep IMHO. Said another way, SO can only give you what you put into it.

Answer 9

I think that there is a valid point in that being a celebrity or at least viewed as a celebrity can help you gain some attention. I think that the LOGO question was interesting because it was used as an example in the podcast which undoubtedly brought in a large audience of viewers.

Since the question was really a discussion around whether or not a question was too simple and easy to be on SO between Joel and Jeff, I think that it hit home with many SO users. Because it hit home, I think people responded by voting up the question and answers.

I also don't want questions/answers to become anonymous because there are some users on the site who have helped me out a great deal and I do feel some responsibility towards trying to assist them in the future. The inverse of this is also true.

Answer 10

Take a look around. Upvoting based on celebrity is not only SO's problem. It concerns many communities. I'm sure such celebs worked hard for their reputation and they deserve it. Well, at least most of them did. It's a common noticeable behavior that celebs tend to lose theirself with time and tons of easily earned votes. Their answers start to sound more general, don't solve particular problem but sound reasonable and on the subject. Neat but not useful for the asker.

It really annoys me when a celeb gives their vague-but-neat answer and his fans like a swarm start the upvoting. I've even herd opinions that such situations scare off people that would place a real problem solving answer: Yay, da celeb again! I'd help the asker but it requires some effort! I'd do the effort even for this tiny shiny vote-up prize. But I won't! This celeb dude put no effort and yet still gets the cream...

However, I do respect those of celebs that still got it and their answers are still sharp.

Answer 11

New Answer

With a limit of 200 reputation per day, Joel probably didn't actually garner 1,030 repuation from that question.

Old answer (apparently incorrect):

Actually, Joel Spolsky only garnered 300 reputation from that question. The max limit for a given question is 300. Any reputation accrued after the 300 limit is 'lost', as it were.

Answer 12

While it is probably true that a question from Joel will always attract more attention and votes than one from John Stackoverflow Doe, I believe that many people voted for his question because of nostalgia:

They remembered their first attempts to move the turtle.