The activity overview currently links to specific comments, for comments on answers. The scrolling relies on #comment-xx
URL fragments, and fails if the comment is initially hidden, bringing one to the top of the page instead.
So, I could either file a bug report for the confusing links, or give this feature request some more attention. Bump! :-) (This has meanwhile been reported as a bug.)
Implementing auto-expanding will still make #comment-xx
-links fail if a comment has been deleted, again bringing one to the top of the page rather than to the answer. To gracefully fall back to scrolling to the answer then, some client-side JavaScript-fu would be needed to first see if the comment still exists, and rewrite the fragment if not? If such script is ever considered: