One screenshot will explain it the best:
It shouldn't be there - appeared right after posting the comment. When reloading the page it disappears so something goes awry with the AJAX handling.
Clicking it is reloading the existing comment(s) and open the new comment text box.