Hard to explain so I'll use pictures. User without Gravatar account, clicking the "change picture" link:
Then clicking the "Gravatar" line results in:
Upon reloading the page the profile picture is back to the default. Guess the change is failing behind the scenes, so we better be notified in such a case and have no display change.