Is it normal to lose your mojo when you masturbate?

Every time I masturbate, my mood dips down and I feel a loss of confidence. I try not to masturbate a lot, but sometimes it's such a relief when I do it...