This all feels like a race where the model companies try to solve doing work locally in a way that doesn't suck, before the major operating systems companies figure out AI integration into their OS that doesn't suck. It also makes me wonder why Google which has both Gemini and Android can't figure this out, and if there are lessons to draw from that.
They are releasing AluminumOS with their Googlebooks, which is a AI forward OS. If its good or not we have yet to see.
Microsoft has Copilot and Windows. Look what happened.
Google is probably already doing and releasing the most actual research into this (like the work that went into Gemma 4)
Folks that are interested in a way of doing work locally that doesn't suck, but which integrates LLMs, may be interested in [Barnum](https://barnum-circus.github.io/). The TLDR is that it's a programming language whose frontend is a DSL in TypeScript that is well suited for managing async and parallel work, focused on control flow, from which it is easy to invoke LLMs, and which is easy for LLMs to write. I use it to autonomously ship a very large number of PRs.
The only lesson I'm taking away is that we are still very early in the AI era. AI workflows look entirely different today than they did 18 months ago and I wouldn't bet on them looking the same in 18 months from now.
I mean a couple of websites will claim 1.6gb ram on my device, what would an LLM model cause across millions of devices, when nobody even wants to use it
> why Google which has both Gemini and Android can't figure this out,
Not the first time an incumbent has four aces in hand and appears to be entirely unable to make anything of it.
> and if there are lessons to draw from that
Lesson 1: doing shit is hard
Lesson 2: money rules so milking the cow wins over taking the slightest risk
Don't you read HN? Nobody wants AI in their OS, especially in Windows. Common complaint that Microsoft is forcing AI into every corner of Windows.
Google is historically terrible as a product company (and has succeeded in spite of that) As their technical innovations become less of a moat (we're already there) they won't be able to win on engineering alone (they are no longer winning on engineering alone)