> As amusing as this may be, I really have no need or desire for my coding model to understand or be aware of ewoks

You'll think otherwise the first time you're a victim of a zero-day ewok.

Seriously though, while coding models may not need to know about ewoks, their contextual knowledge of things beyond just writing code almost certainly makes them better coding models.

It could be difficult to constrain the training corpus "just right" so that you eliminate all the irrelevant subjects like ewoks but retain enough so that the model doesn't turn into an idiot savant capable of churning out correct code but incapable of understanding what you really want.