Is it normal that my ears feel plugged up while exercising?

sounds like sinus trouble, I have it too. Maybe speak to a doctor, and make sure you're not outside exercising in really cold weather!