> Why are we drawing a difference between "prompt" and "context" exactly?

Because they’re different things? The prompt doesn’t dynamically change. The context changes all the time.

I’ll admit that you can just call it all ‘context’ or ‘prompt’ if you want, because it’s essentially a large chunk of text. But it’s convenient to be able to distinguish between the two so you can talk about the same thing.