> Look at image gen: you press the magic button and get a 'Pelican on a Bike' - but you can't just change the 'hat' of the Pelican. You have to press the magic button again, and you get a whole different Pelican on a Bike.
I do understand what you mean and perhaps I am trying to treat it as a problem to be solved and challenge accepted but my first thoughts are if its an vector image like SVG (the famous simonw's pelican on a bike benchmark)
Then you could in theory have a layered approach and then just change the code of the hat so for example (IIRC) <--Hat--> Code. <-- Bicycle-->
So basically I am suggesting modularizing of concerns of areas so that you could have better autonomy over what exact thing you wish to change.
Though I imagine that you and I might be saying the same thing and you are suggesting that the crux of the argument is exactly that you need specific know how in reaching to that said modularity where you can best use AI.
When you might need the generation of the SVG as compared to image generation because you realize that your project might need the pelican changing lots of hats and image gen wouldn't be feasible but for that to actually say to AI, You might need to know in the first place that SVG or (HTML?) might be better use cases for this. Again, I must admit that I am not an expert in this so I can't absolutely comment on what the best thing for this particular use case could be and maybe that might be your point.
Have we arrived at similar conclusion or perhaps, is there more nuance to it?
On a side note: I actually once had a real use case of where I needed layered approach similar to Figma but generated through AI. preferably something which can just work through good ol chat app UI which could give an index.html or other code for this modification/layered approach.
Like recently there is https://bento.page which has been somewhat similar for this in some sense but for pdf's. So is there something different but for image-ish thing? If there is an expert lurking here, I would love to know the answer and gain some knowledge about it, thanks :-D