Is it normal i have to push my penis under my balls to avoid bulging

Before I pull my underwear up, I have to literally push my penis down, under my balls, kind of keeping the affair from popping back up by holding my thighs together as I pull them up. Otherwise, whenever I wear pants, there is an uncomfortably noticeable bulge. Should I feel insecure about the bulge, I already kind of do. Or should I just let it bulge away?