logoalt Hacker News

anon373839yesterday at 10:47 PM0 repliesview on HN

I would recommend trying oMLX, which is much more performant and efficient than LM Studio. It has block-level KV context caching that makes long chats and agentic/tool calling scenarios MUCH faster.