Is it normal to feel funny about my boyfriend and this girl from work?

That's very out of line of him to do. First of all it's a chick and he shouldn't be giving his number to other women in the first place. He is in a relationship with you and if he respects and loves you he will delete her number and stop texting and calling her immediately. If he keeps it up leave him because it will only get worse