In blacksmithing there's the concept of an "anvil shaped object". That is, something that looks like an anvil but is hollow or made of ceramic or something. It might stand up to tapping on for making jewelry or something but should never be worked like a real anvil for fear of hurting someone or wrecking the thing you're working on when it breaks.

I feel like a lot of the AI articles and experiments like this one are producing "app shaped objects" that look okay for making content (and indeed are fine for making earrings) but fall apart when pounded on by the real world.