The big models will never run locally, and I doubt that titan and co will run locally, just way to much resources needed
"never" vs https://en.wikipedia.org/wiki/Koomey%27s_law
Observably, the biggest models we have right now have similar complexity to a rodent's brain, which runs on far less power. Limiting factors for chips in your phone is power, power efficiency is improving rapidly.
alt Hacker News
"never" vs https://en.wikipedia.org/wiki/Koomey%27s_law
Observably, the biggest models we have right now have similar complexity to a rodent's brain, which runs on far less power. Limiting factors for chips in your phone is power, power efficiency is improving rapidly.