The weights aren't deleted, it's just additional fine tuning, is my understanding.
There is no question model quality is degraded by this though.
alt Hacker News
There is no question model quality is degraded by this though.