Is it normal that i reacted like this?

Till a year ago I had Sax lessons with this great teacher. He was a really cool guy, who had a very youthful attitude despite being 21 years older than me, and an incredibly handsome man. I felt an deep connection with him and our relationship was way more friendly than the average student/teacher one. He was a very nice and funny person so we liked to joke and laugh together, and he was also very considerate, so I felt comfortable to talk to him a lot about myself, my life, my problems, etc.
However, I was 16 when I started taking these lessons and I never actually felt romantic feelings for him, nor hit on him in any way. I always thought he was handsome and my mind did wander a little, but I think it's normal for a teenage girl, and I never really acted on it. He was also married and with a son. Then, when I was 17 and I was talking to him after a lesson, he told me something along the lines of "I would like to take you out for a beer" (I'm not in the USA, minors can drink in my country) "but I'm afraid that things could get out of hand between us". I was actually a little shocked that he implied he wanted to have sex with me, and that he thought I wanted it too. It's not like I was an innocent angel even then, but I didn't want a relationship with him and I was afraid I was unintentionally giving him the wrong signals. He asked me out again for a friendly drink on different occasions (but just a few times), but I had to turn him down each time for true reasons, and just once I lied about being busy. I wanted to go out with him as a friend but I wasn't sure I could really refuse him if he started flirting with me, because he was still an handsome and charming man and I was a teenager with hormones who generally liked older men. I didn't want to be his lover, and at one point I was sure he wanted that because he started to act a little differently, smiling and talking in the way you do with someone you want and sometimes hugging me or kissing me on the cheeks to greet me (he never did that before). I didn't know what to do about that situation, and I still wanted to save our friendship: he was still a wonderful person and it's not like he ever sexually harassed me or pushed me into something I didn't want. But it was still weird for me, so when I turned 18 and some time later I had to quit my lessons for unrelated school reasons and lack of time, I didn't contact him again even if he asked me to. He was very serious about it! He didn't have my number, and he probably couldn't ask it to the Music School he was employed by, or maybe he just didn't want to because he thought it was going too far. I haven't been in touch with him ever since, and I ofter find myself regretting it because I feel I lost a very good friendship. Was I wrong to back out like that?