alt Hacker NewsIt seems like a stronger story for robotics, since smaller models can always react to the environment faster than large models at a given hardware budget. Also because robots that keep their models local for latency or reliability aren't going to be carrying many kilowatts of inference capacity.
remote inference should be sufficient for most robotics applications with potentially a small model for safety critical actions running locally.
Unless you are in military robotics or automotive of course :)