Voting to close a question on any SE site should force the voters to actually sit down and state the case why this question should be closed. No more just pushing buttons and leaving but you actually have to type out and state the case.
Then a report is set to the questioner and that will give the questoner a chance to see what is going on or to rebut.
Then the report can be attached with the rebuttals and the questioner can have a chance to send it to a jury of randomly selected users or mods excluding the intial close voters and the questioner.
Once the jury has decided the user can appeal up and for the final time once this appeal has be used the question is marked and judgment is final.
I think this a rather fair way to contest closure of questions and it allows for further clarification as to why the question was asked.
Edit:
After responding to someone, here is a more clearer way on how this might work.
Sally writes an question and its gets posted. Jannett votes to close.
Jannet on the vote to close form, writes up a reason and then points out what is the offending thing, then sends it off.
Sally in her inbox gets the vote form and sees what needs to be done for the question.
Sally either rebutt the vote directly, give some reasoning or explain why she think this wrong.
Or Sally can then change the question to fit the objection and submit the form back.
Jannet has her vote back and click an option to return the close vote or she can option to dispose of the vote effectively removing the vote from the question.
If Jannet not happy with the changes she sends the vote back.
This creates a means of making sure that the people who have vote to close holdings on their question have an opportunity to address and make sure that their is effective comunication.