TL;DR I'm proposing the following:
When someone posts an answer and the corresponding question is closed within a certain amount of time after that, then, for certain close reasons, all rep gained from that answer should be reversed.
First off, there are two questions here on Meta.SE that already deal with "should closed questions award no rep". But:
- This question is not a dupe, as I am only interested in what happens to answers.
- Both questions are more than 3 years old, and I think times have changed since then.
Now, I assume most of us know the FGITW problem, which for bad questions turns into "repwhoring" - for those who don't here's a situation I run into frequently on Stack Overflow with javascript and php questions:
- A bad question is asked (typo, off-site recommendation, opinion, ...).
- I see it, vote to close, and maybe leave a comment, explaining why this type of question is unwelcome on that site, or for typo questions, point out the typo.
- A bunch of bad answers appear, usually low-quality (code-only, link-only or very little text), for typo questions just pointing out the typo (basically the same as my comment), or sometimes even asking for clarification/not even answering the question.
The answers that don't help the asker usually get downvoted, but those that do technically help (in pointing out the typo, or providing a link) are upvoted.
According to the Meta consensus, this is bad, and such answers should be downvoted.
To some point I agree with that, but I think this is also bad, because
- The information they provide is technically correct, so downvoting seems inappropriate.
- You lose rep when downvoting them, which is going to stop a lot of people.
- They get 5x the amount of rep from a single upvote that they lose from a downvote, so unless the down:up ratio is 5:1 or higher, they still make rep overall.
Now, why are those answers bad in the first place, if they are technically correct?
- Because they encourage questions that get closed, i.e. questions that are not ok. This encouragement is bad, so in order to discourage bad questions being asked, we should also discourage the answering of bad questions.
- Because when voting to close the question, you are trying to enforce a quality policy. People who ignore that policy get rewarded. That feels wrong.
In the two questions that deal with rep from questions, the biggest issue is of course:
Duplicates
If the question has already been asked, that does not mean the it is bad or off-topic, only that the asker didn't do enough research.
I therefore think that the "duplicate" close reason should be excluded from rep reversal.
The same holds true for questions that are migrated away - they're not bad, they just belong elsewhere.
Now a few other potential problems with this:
Taken from Sampson's answer on the first linked question:
Reputation in general is a reflection on your status with the community. The events that take place prior to the closing of a thread reflect your participation in the community, and is therefore not subject to change because somebody else broke the rules[.]
Absolutely true, only that by making someone feel like it's ok to break the rules, you harm the site. Closing doesn't change this, it only confirms it.
And from Robert Harvey's answer:
Closure is the state in which we put questions that need improvement. Closing a question prevents further answers, but if someone posts an answer that is good enough to attract upvotes, I don't see why we should penalize them for that.
Because it still encourages bad questions. Which is bad.
And nobody should be penalised, just not rewarded for it.
Also from the same answer:
If you don't want users to gain rep from bad questions, be diligent about casting close votes, so that the question gets closed before anyone can post an answer to it.
That is one of the things we're trying to do in the SOCVR chatroom, however:
- While that might have been enough in '12, in '15 the highest-traffic tags are so high-traffic that this is just unfeasible.
- People start complaining about voting rings if we do that.
- There is a four hour grace period for answers after a question has been closed.
Then, another problem is the time span between the posting of an answer and the question being closed.
Currently, deleting a post older than 60 days does not reverse rep in most cases - I think the same should apply if closing caused rep reversal, but with a shorter window, I propose 3 days.
Then of course, if a question is reopened, that rep should probably get re-awarded.
Now wait - that might drive people to vote to reopen bad/off-topic questions, right?
Totally true, but
- The number of people who answer bad questions and have enough rep to vote to close/reopen a question is not that high - usually those answers come from low-rep users.
- If that happens, you can handle it the same way as any other privilege abuse:
Flag for mod attention.
So, my full request (with request for comments) is:
When someone posts an answer and the corresponding question is closed within X days after that, and if the question has not been closed as a duplicate or migrated away, then all rep gained from that answer should be reversed.
For "X" I suggest 3, but that is just based on my gut feeling.