alt Hacker NewsThis seems really cool actually. Just read thru the README and watched the demo gif. Any examples of what you've built with it so far? Might have to play around with it tonight. I've been getting pretty heavy into local LLMs since getting my 5090. Amazing what Qwen can do given how small it is (running 35B at Q4 quant).
Replies
mystraline • last Tuesday at 12:44 PM
Check out Krasis https://github.com/brontoguana/krasis
It enables something similar to unified memory. Ive got a 5060 (16GB) card and 96 GB ddr5.
I can run qwen3.5-122b int4 at 25tok/sec.And now even does image ingestion!
Ive been bulk transliterating and translating foreign language books into english. And all completely local.
➕ show 1 reply
It is dumb but very specific to my use case but an agent that runs every evening to pull both my calendar and time logs (Google sheet). The calendar I do every morning to time block my day, then throughout the day I record what I did and categorize by Eisenhower's matrix. Then it compares map vs territory and I hopefully adjust my priors to do better planning or flag time sinks.
Cool thing is I built the tools with the [Tool Builder](https://github.com/fabritorio/fabritorio/blob/main/docs/node...) as well, pretty small CLI helpers. https://imgur.com/a/XeYYbzC