Is it normal that I would rather not have sex than use a condom?

This isn't unusual. Some men just don't feel the same amount of pleasure through a condom.