I think LLMs go against the retrocomputing ethos
Then so do emulators, flash drives instead of 1541's, etc. Nobody forces you to use generative models to get older hardware to do its thing, you're still free to try to get the actual hardware to run, free to build interfaces to get QIC drives connected to whatever you want them connected to, etc.
It removes the fun of figuring things out by yourself and the learning how to learn things. Also the lower complexity these systems usually have vs what we use today.
I don’t see the appeal either, but perhaps the person using takes something else from their retrocomputing use.