Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 158 Stack Exchange communities.

What is meta?
Here's how it works:
  1. Any Stack Exchange user can ask a question
  2. The community provides support, votes on ideas, and reports bugs
  3. Your voice helps shape the way Stack Exchange operates

Currently the data dump does not have enough information to do accurate reputation calculations. For example, if you cast a downvote on someone else's post the -1 penalty you incur is not recorded in the data dump. I think there are other issues as well, but that's the one that sticks out at the moment.

Now, there is good reason not to record the individual votes themselves, but you could aggregate it. Perhaps something like a day-by-day offset that accounts for the difference, recorded in the votes table via a new vote type and new column (OffsetScore). Of course, I haven't seen your actual schema for recording and handling these issues, and so there might be a better way to do it. But something to allow data dump queries to account for the anomalies would be nice.

share|improve this question
Is stackql up still? – jjnguy Dec 7 '09 at 5:16
Unfortunately, it's been down for a while. I'm moving in < 2 weeks (right before Christmas :( ) and don't have time to spend figuring out why (appearances sometimes to the contrary). Sorry. – Joel Coehoorn Dec 7 '09 at 5:46
That said, as soon as I do get time it's near the top of my list. – Joel Coehoorn Dec 7 '09 at 5:46
It's up again now, but it's not reliable/stable yet. – Joel Coehoorn Dec 7 '09 at 20:06

While I would like to see this I don't think it'll happen. Order of votes matters so the only way to resolve that is to put the timestamp of the vote, which was removed for the risk of de-anonymizing the data dump.

Of course the other way to do this (which I for one would prefer) is to get rid of the silly corner cases in the reputation system (like vote order mattering), but that's been declined in various forms many times already.

I haven't had a detailed look at the data dump but is it possible to figure out which votes were applied against CW posts and which weren't? Remember that a post may change to CW at some point so some votes might give rep and some might not.

More to the point, I can't confirm that the count of hitting the daily rep cap also takes these things correctly into account.

share|improve this answer
Regarding order of votes, it is possible to establish the order of votes relative to one another by examining the autogenerated VoteID. However, exact times would be needed to relate the order of votes related to other events. CW is a good example, you can't tell which votes are applied before a post became CW as opposed to after, since the time of the CW and the time of the vote are both mapped to the nearest 24 hour block. Also, the effect of deleted posts isn't easily seen in the data dump. – ベレアー アダム Dec 7 '09 at 15:12

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .