Is it normal that I can't leave my boyfriend?

Just say exactly what you've written here to him. That'll sort things out, don't tell us, tell him