That's why ears have cartilage, to keep them from flapping.