I use my Facebook account to log-in into Stack Exchange sites. What would happen if I accidentally remove Stack Exchange app from my Facebook account? Do my all reputation points, Questions & Answers get deleted?
As long as you have another way to log in, it's fine--you won't lose anything.
If you remove all your logins, you may be unable to log in, though you will stay logged in for the duration of your browser session.