I've had an endgame idea in mind for a while.

Models, probably first open weight ones like Kimi K3 class, are etched into silicon like this and sold as cartridges almost like old school game cartridges.

You buy a USB-C dongle that the cartridge goes into, or for data centers you have PCI cards that take these in slots.