I think this will be the future. LLMs will know enough to know that it should hand things off to something else.
It's the present. ChatGPT, for example, is an application. It uses models, but it does all kinds of stuff at the application level too.
alt Hacker News
It's the present. ChatGPT, for example, is an application. It uses models, but it does all kinds of stuff at the application level too.