Currently, the number of "votes cast" excludes votes on deleted content. Once something gets deleted that you voted on, that vote vanishes from your stats. This of course happens frequently especially with down-votes - if you're a good voter, stuff you downvote often ends up getting deleted.
Seeing as the idea behind the public display of total votes you've cast is to encourage voting, is this really fair?
Also, doesn't it distort greatly all voting stats, especially when looking at candidates for moderator elections and such?