If it can work with 100B parameter models then stopping with edge devices makes no sense. This kind of compute-in-memory technology being so much more efficient would make most or all existing data centers obsolete. Or so it seems?

Also, they are saying this efficiency is going to become standard. I think this is the type of technology that will allow AI companies to keep increasing the size of AI models. So they will not be bottlenecked by energy needs to make the next qualitative step in intelligence.

It also points towards the next step for local AI after chips like RTX Spark. So say 18 to 36 months from now (or pick your more optimistic timeline) we expect performant local AI to be everywhere.