As @CinCout's answer shows, it's technically possible. If there would be a good reason to prevent this in general, the developers would have grayed out the Draw Attention option if there were any (positively scoring?) answers.
However, in rare cases†, it can be that the ♦ moderators feel that there's no need to open old wounds, whether that is because of an edit to the post, a new answer or a bounty. Some things should definitely not be forgotten, but drawing more attention to it is just ... inappropriate and/or not likely to improve the general atmosphere here. Remember that
Moderators are human exception handlers, there to deal with those exceptional conditions that could otherwise disrupt the community
A similar case would be somebody putting a bounty on a list-like question which should've been closed, historically locked and/or deleted. I can imagine myself removing a bounty from such a question, especially if the 'Draw Attention' reason has been chosen.
†: I'm not sure if your recently removed bounty applies, I've only skimmed the question and wasn't involved in the incident or the decision to remove the bounty. I would have said the same even if we were talking about a hypothetical situation.