Is it normal that i didn't want to take my car?

Ok so earlier in the week my boyfriend told me that his friend was going to a record store that's a bit of a drive from where we live and that he was going with him. He said that if I wanted to I could come along too and that he was letting me know now so that I wouldn't make any plans for that day. Four days later he said that he wasn't sure if his friend was going anymore but that he really wanted to go so I told him that if his friend didn't go that I didn't mind driving over there, I would do it for him. So the day comes and his friend is going and he tells me by when to be ready. He later texts me if it was ok if we went in my car. I texted back saying I guess. The whole time I had in mind that his friend was the one driving because after all it was his plan to go with my boyfriend. My boyfriend just invited me. My boyfriend replies back saying nevermind, to forget it and asked why and he says because I don't want to use my car. I told him that I thought his friend was the one driving and that I was going to chip in for gas (which I really was). He repeated himself by saying to forget it. Time passed and I asked him if we were still going. He said no because I don't want to use my car and his friend had given him an attitude so he didn't want to see either of our faces. Now I'm not sure if I'm in the right or I'm not being fair in the situation. I know his friend and I get along with him and whenever I've gone in his car which has probably been maybe like 3 times it's because my boyfriend invited me to hang out with him and his friends. I understand if we all make a plan we decide on who's driving and if we're putting in for gas money, but they are the ones who originally wanted to go and had planned it, I was just invited. I'm not even really good friends with his friend, we only hang out when I'm with my boyfriend. I understand that the place wasn't near so I was planning on giving him some money for gas anyway. Was it fair that I didn't want to take my car or was my boyfriend right with getting mad at me? Just in case my boyfriend doesn't have a car anymore and his friends car is a used car and I have a newer car. Neither of them have a job at the moment and they're not good financially. I can still go out and I have a job, so I don't know if that leads them to believe that I can drive wherever and it's not going to be a problem for me financially. I am however trying to save my money and I'm not really allowed to be driving that often and especially to far places and I don't know if also what I had told my boyfriend earlier about driving there if his friend didn't go also made him think it was ok if I took my car even if his friend was going? But in the end what I care for most is about being just and fair. Hopefully you guys can help here. Thank you in advance!