Whether they accept or not, they won't get rep they offered in the bounty (unless a moderator ends the bounty and return the rep to the OP with is only when a moderator found the question should be closed).

And if the OP doesn't award bounty. Half of the bounty will be awarded to the most upvoted answer.