On Role-playing Games we've found that users will often downvote a question and complain about it being off topic, but not vote to close it.
I would like to see a popup when downvoting a question that says something like:
Does this question really belong here? If not, please vote to close.
Obviously this wouldn't make sense in established sites like SO so perhaps it should be tied to the lower vote threshold or even beta.