I find it strange that there's a 5 second limit between Comment votes. I sometimes read a few comments, and decide on the good ones, and then when voting it's like "damn, now I must wait".
Completely agree. I typically read all the comments first and then vote up 2-3 that I find useful. (But have to wait 5 seconds between votes).
I am working to make myself vote after reading each comment. But even then it normally takes me 1-2 seconds to read a comment (most are one sentence), which still leaves me with a 5 second warning if I vote two comments up that are close to each other.
As I think, the idea behind having 5 seconds gap in comment voting is to ensure that you read a comment and vote it, then read the next comment and vote it. Invariably, you will atleast need 5 seconds to read one comment after the other.
The idea is to avoid people from simply voting on comments to gain some badges. So when user sees there needs to be 5 seconds gap, he is probably forced to wait for 5 seconds and inturn he might end up reading the comment as well... :)
In your case and to very much my case as well, I read all the comments at once and then go on the voting spree. So I like your point where you are bringing up this to the notice of SO developers.
On one hand you're right it might be irritating when you read them first.
But on the other hand, this is good protection against people who vote comments up without bothering to even read them. They will vote up the first, then give up when having to wait 5 seconds, or even better take that time to read the comment.
Bottom line, I would keep it like this and remember to vote up each comment after I read it, if it was good.