You know the best what makes you happy and healthy. And if people in your life judge you and your decisions to accomplish that, it's ok to let them go and not be a part of it anymore. No matter what current societal stigmas oblige us to do or be like, there is a limit to how much you can be polite about for "things to be good".