When voting to close a question, it does not appear that there is a way to know what the previous close votes were. For example, if a question has 3 close votes already and I go to close the question as well, I have no way of knowing what those other 3 close votes were. A good example here would be a question that 3 people think belong on Super User but I think it belongs on Server Fault.
This feature already exists. Note the "(1)" and "(2)" by "belongs on serverfault.com" and "belongs on superuser.com" respectively. This indicates that 1 person voted to close as "belongs on serverfault.com" and 2 people voted to close as "belongs on superuser.com":
Yes you do. There is a little number next to each reason of previous votes.