I have asked several questions and the persons answering have low numbers for the "score." Because they have answered they may have kept those who might have seen an unanswered question and read it. I think because a question has a couple of answers it keeps others from even looking (they like to not waste time and help the unanswered questions.) Yes this an assumption.
For example, I asked a question and someone with 23 clearly said they didn't understand but then answered (wrongly) about my question. Now the question appears to have an answer, though unaccepted, and I believe will keep others from looking.
Maybe a threshold per question could be set for what you think is an appropriate number of "skill points" for the answerer. Yes I know someone with 13 might have the answer but SO is big enough that there are a lot of range of folks so many answers would still come and more likely quality answers. SO is so big it's getting harder to get that. Obviously, this is IMHO. No personal offense intended.