I'd cut loose the drugs for starts.
Not my place to judge people, I've never done drugs myself and I don't plan to. It's up to you to do what you want in your spare time.
However, that stuff really doesn't make a person more attractive socially. I've met quite a few people who do cannabis and generally I find it makes them harder to engage with, not more "laid back" as many who smoke it seem to think.
It has all of the connotations of smoking tobacco (bad breath, smell, health issues) plus the added dimension that being "high" can actually make you come across as a bit of an idiot in front of others.
As a non-smoker, being around "blissed out" people is annoying. No one wants to hold a smart conversation with you half the time and it's hard to explain, but it seems kind of...selfish? It's sort of like putting self-gratification before the person you're hanging out with.
I dunno, that's the best I can explain it.
But yeah, "potheads" (who I'd define as those who smoke as a habit) are not really very attractive or fun to be around if you're not into that stuff. If you like it too much to quit, at least consider cutting down a bit.
Of course, doing drugs also carries (however unfairly you may think) other labels, such as being reckless and/or hedonistic. So think carefully about what unintended impressions you may be giving people with your drug use too.
Apologies if any of this offended you, but my advice is useless if I'm not honest with my thoughts
