Is it normal to refuse love out of pure prejudice?
So I'm in this very artistic program in college (graphic arts), although I'm not even remotely artistic, where the student body is literarely divided in three: the hipsters, the bitches and everyone in the middle. Being a fashion-obsessed socialite, I am definitely part of the bitches. People speak to each other cross-crew, but not a lot.
Last semester, I was with the same few people all the time in my classes, and there were about 20 people that I never saw (considering there are about 50 people in the program). Of these 20 people, there was this guy that everyone in my crew hated. Apparently, he was an attention-seeking hipster that talked really loudly and that bursted in everyone's conversations all the time.
This semester, however, this guy almost all of my classes. Although I don't hate him with a fiery passion like most of my friends do, I do find him freaking annoying at times (his constant need to draw attention to himself at all times is overwhelming). However, I also think he's by far the hottest guy in the program (I seem to be the only one to find him really attractive), and I heard by a few people that he was smitten by me.
One random day in class, I decided to text him and play a little with him. I'm sure how it happened, but we quickly started to become "text message friends" and things evolved insanely quickly. He told me tons of personal things about him, I told him some about me (sexual things, everything). Through our "text relationship", he haven't made it a secret that he liked me more than as a friend, and, honestly, I think I would be lying to myself if I said I wasn't interested at all. However, we still barely speak to each other in person. He tries to, but I constantly shoot him down with one-word answers and cold stares because I fear the reaction of my friends if they know I might be involved with him.
Now he's texting me more and more, telling me how much he's thinking of me, and that he wants me to come over for the night and everything... To be honest, I'm very interested, but I don't know if I can handle everything that would come with the relationship... He's one of the sweetest kids I've ever met, he's really funny, he texts me all the time and I think he's handsome... but at the same time, I'm pretty sure my friends would judge me eternally for pursuing a relationship with him. I talked about him to one of my friends, and she brushed it off as "pity love"... I know some of them that would approve, but I see all of them almost every day and I will keep seeing them for at least another year and a half (the rest of the program), so I'm not sure I want to give them a reason to bitch about me behind my back for a complete year...
Is it normal that I'm so confused solely because of my friends' prejudices? What should I do?