Why do they say "You can not have your cake and eat it to"?

Actually that way of looking at it makes a lot more sense. Since my view just makes whoever is telling you just mean selfish.