I wonder if the solution is either an intermediary "model spec" that can render into others (this becomes the target for all these model models), or an LLM style hack where its trained on recreating 3D models using code, I know for CAD (I forget which one it is) there's a CAD program where your models / designs can be written in code.

One weird thing I run into is, I can have Claude make some interesting things with threejs, but translating it to other engines isn't always so great, and its usually raw code. I'm not a 3D guy, I just want to get up and running with things I can code / think of.