Is it normal to be a virgin and have him turn me down?

That's precious, and you should keep him. If he wants to wait, he's a needle in a haystack.