What should i do about my friend?

I hate going to far off places in the city for no good reason so whenever i want to go downtown to see the lights i always bring my friend Charles over. I knew him ok in high school but he was very unpopular and only had a few friends. but recently I've hung out with him because he's never busy and unemployed and he is just another ear to talk into. Although the more i hang out with him the more i begin to realize what i mismatch we are, he's very depressing to talk to. Whenever i just discus things i'm planning or thoughts that have entered my mind its he always responds by trying to connect it to an Anime. It seems as though thats the scope of his life and it depresses me, Anime, and mobile games.... In-fact what about him doesn't depress me. Every idea i have he finds the negative and is always so annoying about it. When ever me and the other guys joke about women, he always jokes about what a "loser" he is and emphasizes how "nice guys finish last" and he has no solution to finishing first. He is so Depressing, at a fun dinner with the guys he'll mention how he was bullied and high school and elementary school and become a toal bzz-kill. Sometimes i can look past things like that, but now as i bring him to events with my other friends he'll embarass me pulling out his middle finger all the time and photo-bombing us when trying to make nice photos. He'll even outloud mention sex and sexual remarks as we go to other public places. Its getting out of hand, but i worry that if i just give up him i'll have not go to person when i want to walk or go to a certain part of town. I hate traveling alone. what should i do.