logoalt Hacker News

gorgoilertoday at 9:17 AM0 repliesview on HN

”In browsers, the last successful product innovations were tabs and merging search with the URL bar.”

I see the point Ben is making even though there are a lot of nerdier innovations he’s skipping over — credential management, APIs (.closest!), evergreen deployments, plugin ecosystems, privacy guards, etc.

One aspect that model execution and web browsers share is resource usage. A Raspberry Pi, for example, makes for a really great little desktop right up until you need to browse a heavy website. In model space there are a lot of really exciting new labs working on using milliwatts to do inference in the field, for the next generation of signal processing. Local execution of large models gets better every day.

The future is in efficiency.