If it keeps you from living a happy life, it’s never “the right thing to do” to stay with someone, be that your “family”, bad “friends” or whoverer else. If you can find a way out of that mess and into a better place, take it.