alt Hacker News"LLM backends: Anthropic, OpenAI, OpenRouter."
And here I was hoping that this was local inference :)
Replies
__tnm • yesterday at 9:29 PM
haha well I got something ridiculous coming soon for zclaw that will kinda work on board.. will require the S3 variant tho, needs a little more memory. Training it later today.
peterisza • yesterday at 9:06 PM
right, 888 kB would be impossible for local inference
however, it is really not that impressive for just a client
➕ show 1 reply
Sure. Why purchase a H200 if you can go with an ESP32 ^^