Is it normal to think abour your ex after rejecting him?

I was going out with this guy and he lives in a different country. We've seen each other before it just we never kissed or do anything further than that. We just talked hanged out as friends. That time he was only here for vacation. After a week he went back home and we started chatting online. He became my bf after 3 months its just he doesn't make an effort to communicate with me. He will talk to me once a week and I think it was kinda sad since I feel like he don't want me that much. So we broke up. After 3 months he wanted to give it another try and he will change but still after 2 weeks of messaging he left me hanging and does it again the 3rd time he comes back and pretend nothing happened as if we are still together. I wanted to talk to him but I cant since he only emails me and when he goes on skype he dont even bother to message me. after four months without contact from him ive meet someone he became my bf. Then this guy which is my ex called me and said what happened? and he wanted to see me because he wants to propose.. and I said to him.what? you were never there, and you always left me hanging...i gave you chances but its still the same. Then he told me he wanted to see me and I told him no. he got so mad at me and said whatever and fcku. Now i feel like its all my fault and cant stop thinking about it..and maybe i made the wrong decision of rejecting him and finding someone else.