I'm suggesting this not as a SE feature, but as a MetaSO feature.
I just went through and up/down-voted a slew of items in a CW poll only to find that it was counting towards my daily-limit. CW votes don't cost/grant any rep, so why am I limited? Kinda discourages real heavy participation in poll's (upvoting answers you like, downvoting those you don't.) I can't really downvote the answers I like without losing the ability to grant people up-votes in non-cw questions. Stinks.
Note: Votes a demonstrably different in CW/Non-CW questions. In one, score and rep is tied in, and in another it's not. I'm not making a case that the two atmospheres are different, SO already treats them differently. I'm suggesting we extend that treatment onto daily-limits too.