Is it normal to be afraid of near-dead/dead fish?

Every time I see lethargic or dead fish, I freak out. I don't know what scares me most about them. But, the colourful ones smaller than my palm scare me the most.