Our mutual cheating

I am in a long distance relationship with a great guy. He is my first bf (I am a guy myself - I used to date women) and I love him incredibly. He loves me a lot as well.

The thing is, I found out a few months ago that he slept around with other guys via websites like cam4.com and gay profile sites.

This was quite a shock, as I always trusted him.

I confronted him, and we dealt with it (sort of) and we moved on.

Now I am pretty sure he still cheats....and I have also started to meet up with guys for sex.

I don't feel guilty when I do this. It's about lust (and a bit of revenge). However when I think of him cheating, I get angry and sad....but still forgive him - thinking of that I am doing the same. Regardless, it doesn't feel right.

I am hoping that this will end and both of us will be loyal again when we move in together - hopefully soon. But I am unsure. I don't want to cheat on him anymore and be loyal. But I am not sure about him.

Is this normal?

Should I continue this relationship? Am I better off with someone else? Or is this just part of a gay relationship?

Maybe I should start dating women again?