Is it normal to hate time-travel fiction paradoxes?

I find them confusing. I watched the first 2 series of Misfits recently, and that involves confusing time travel stuff. When I was watching it, it made me think, and the more I thought about it, the more it broke my brain. I just can't really wrap my head around it without going in circles.

I understand your frustration, although I'm just more confused by it, rather than annoyed or angry.