logoalt Hacker News

varun_ch • today at 4:04 AM • 3 replies • view on HN

This feels like a lot of work for low reward, the technical/business infrastructure would be wild. And if anyone wants to offload their prompts to users browsers, they might as well just use the Chrome API correctly? How many server side prompts would realistically be useful to offload to a low end model like this?

Plus even if you really wanted to do that, WebGPU exists and has for a while right?

Replies

dnnddidiej • today at 6:43 AM

Nefarous use cases. Run that on some suckers machine.

Edit: simple example is a spam bot

dotancohen • today at 5:49 AM

  > This feels like a lot of work for low reward
Low per-device reward combined with a high user count - either by large legitimate players or by botnets - has been the monetisation strategy of most online enterprises.
jameslk • today at 4:12 AM

> How many server side prompts would realistically be useful to offload to a low end model like this?

There's a lot of ways this API could go, e.g. more powerful models eventually, or perhaps integration with cloud models. For example, I could see Google trying to default Gemini as the model for users signed into Chrome

➕ show 1 reply