logoalt Hacker News

nekusaryesterday at 7:18 PM1 replyview on HN

Local LLMs.

Krasis is one such tool that allows large models using blended GPU/RAM.

ik_llama for better performance than llama.

ComfyAI for local image generation.

Nanocrab seems better for orchestration. Still need a good system capability firewall.


Replies

nativeityesterday at 7:34 PM

Who’s buying the memory for this effort?

show 1 reply