That's great tool but the issue the design of the AI even if it like that easy to change it fix it what ever they still creating the same template of designs i think they needs a lot of samples that are real from real designers to use them as a source. For example when i was creating my platform about 2 years ago designing it was the most complex part because the AI was making a lot of mistakes in layers and z-index and content appearance and much more. But now a days those issues becomes much more rarely to appears and the big issue in the creativity of each design because each design now a days it looking same. I wonder if in the future you will use real designers designs as a source?
ya I think the agents are only as good as the tools and resources you give them, I've run into the same problems you're talking about, and typically I carry around a design register / design guidance package that the agent loads and builds on top of, and that makes a big difference. one of the benefits of being local is being able to plug in your existing flow: experiment and play with different approaches to see what works.
cloud platforms / walled gardens are sometimes annoying for that reason, you might have a workflow that works but the platform doesn't support it yet. I prefer to work where I can experiment the most given how rapidly things change.
Design work with AI is definitely a game of balancing creativity and flexibility with the constraints defined in the design system, and it's been something we've thought a lot about.
Onlook lets you add browsers and images to your projects to be used as context, so it's already a strong tool for working with design references
Another way we're addressing this is by keeping the projects you're working on separate from the self contained design artifacts you may generate in the process. Since these can be easily used across projects we find that it's very low friction to take a cool but discarded thing you sketched once and repurpose it for another project where it may fit in better.