> the codebase still grows. It always grows.

Well, yes. I mean, it's in the name Generative Pre-trained Transformer: they're text generators!

To delete text using a text generator, you have to emit the original thing taking care to omit the deleted stuff during emission. It's more work.