I concur with the first part of your statement on hubris, but to be fair these models moved beyond language a long time ago.
They now have everything from videos and 3d modeling to robot behaviour be part of the training.
L"L"Ms is a bit of a misnomer that's stuck. Language just happens to be our interface to the AI.