The problem is if no one can describe something with words without an LLM to scour though every line of code it probably means it can't make sense to humans.

Maybe that is the idea (vibe coding ftw!) but if you want something people can understand and refine it is good to make it modular and decomposable and understandable. Then use AI to help you with the words for sure but at some level there is a human that understands the structure.