logoalt Hacker News

WebLLM: high-performance in-browser LLM inference engine

25 pointsby saikatsgtoday at 2:02 PM7 commentsview on HN

Comments

TekMoltoday at 3:12 PM

This seems to be the demo:

https://chat.webllm.ai/

I am getting:

    WebGPUNotAvailableError: WebGPU is not supported in
    your current environment, but it is necessary to
    run the WebLLM engine.
On both, FireFox and Chromium on Linux.
refulgentistoday at 2:44 PM

Project is de facto dead, used it for many years and had to rip it out 6 months ago, don't waste your time.

show 1 reply
nnevatietoday at 3:59 PM

[flagged]