Is it normal that i'm lonely at weekends?

I'm a freshman at a small college, and this is almost the end of my first semester now. "I don't have any friends to hang out with"--I know it's a common query in google, but that's how I can express my situation. I know a lot of people, and talk to them when I'm in class or lab, or at the dining hall, or whatever place people need to go. I have two roommates as well, but they both have their own friends. I'm afraid of sitting alone as people think 'this guy is weirdo'. So I try to sit with people who I vaguely know, at least I avoid not to seat alone. But I never felt like I was there, a part of the table or the group. I can't talk much; I mean what more I can talk about after a few common bullshits like how's everything, what's your plan for the upcoming thing, blah, blah, blah... No, it's not like I'm that douche-bag who doesn't listen to what other people say. Neither that I don't ask them questions. It seems to me that people just don't, they just don't like to talk to me. I think I'm such an uninteresting person to talk to.

But, it was not the same back in high school. Yeah, I know I'm a little introvert, but I had really great friends! Pretty much everyday they say that how much they miss me. We had lot of great memories; I forgot a lot of them though. People tell me they had such an interesting thing with me, and I suddenly remember and laugh together. Why I'm saying these stuffs? Because I know I'm not one of those kids. Still it hits me hard when people leave the tables after trying really hard to stay, when I have to desperately look for people to talk to, when no one bothers me telling about the party or the event, when in the Friday evening I feel so down that I have to convince myself whether or not 'is it normal?'