> They usually just wander off to die alone in the cold.
Usually! But not always.
Every once in a while, one probably makes it to another colony many miles away, and helps prevent inbreeding as a result.
Or runs into a similar weirdo somewhere in between.
Penguins live in large colonies and, as a result, generally do not have issues with inbreeding.