logoalt Hacker News

ranger_danger • today at 3:42 PM • 2 replies • view on HN

You might be interested in https://prismml.com/news/bonsai-2-27b


Replies

kolbebe • today at 4:08 PM

This looked exciting until I read that it gets stuck in loops and generally wasn't a useful model

➕ show 1 reply
joking • today at 4:12 PM

for 32gb, this is my model of reference now, you have to run it with a patched version of llama and is still not available in lmstudio or omlx, waiting for that to streamline the experience a bit. But so far, the best i had till now.

➕ show 1 reply