Is it normal to have gay sexual thoughts?

Im a guy and straight and even have a girlfriend, but sometimes i have these gay thoughts and urges. Like idk if its normal but im not gay (atleast i dont think i might be, maybe bisexual) but i wouldnt mind getting with another guy. Just to see what its like, i would never get into like a relationship with another guy. I wouldnt mind trying it out though, is this normal??