I couldn't delete my comment using iPhone 4 (both orientations), I was only able to edit it. However, on iPad, editing and deleting work normally.
Edit: to be more specific, 'x' button doesn't appear, but 'edit' does appear.
Device used: iPhone 4 - 6.1.2
SE: Mobile version
SE full site works normally.