Is it normal to be uncomfortable near drunk/ high people?
So a little background, my dad was an alcoholic and is super creepy when drunk. Like won't get out of your personal space, always has to be awkwardly grabbing your shoulder, flirting with girls who are like 20 (he's 60), occasionally slapping me in front of people when I try tell him to lay off, and never shutting the fuck up drunk. And I experienced this throughout most my childhood. Well eventually he got into drugs and while I never saw him while high, I did see the effects on him and that enough made me uncomfortable as hell.
I'm now in my early 20s and most my friends are either drinking or smoking weed and while they try to get me to come to parties with them or just try getting high once, I can't do it. I don't wanna be around anyone who's under any influence. I try not to be a killjoy but being around them when they're going out to smoke makes me extremely uncomfortable to the point where I get tempted to call my mother so she can get me away from it (yeah, I know, embarrassing. It's never happened but I fear one day it will) since I can't drive.
I know this is probably really weird but another part of it is that I fear someone will try to sexually assault me when I'm around drunk or high people. Not sure why. I may have a few repressed memories or something since I do have a history of mental health issues but this has been a huge fear of mine since high school and I have no idea where it came from.
I guess all I want to know is if this is normal or if there's at least anyone else out there who feels the same way since I feel really alone with this. Like can you at least see where I'm coming from here?
Edit: Oh, I forgot to mention an important detail. The drugs and alcohol are pretty much 90% of the reason my parents divorced too which was kinda a major cause of the whole mental illness thing.