Is it normal to not look someone in the eye when your talking to them?

Yeah its normal, Its a bit intimidating if someone just stares at you intently while you're talking.

Depending on the person, it may even be funny.