Yes, context matters. The greatest painting in the world is just crushed materials smeared on a canvas, it's nothing too special without the context.

A computer (not even an LLM, just something generating random pixels) could randomly generate the exact same pixel pattern as the greatest painting in the world, and it would not be the greatest painting in the world, because context matters.