logoalt Hacker News

simonwtoday at 5:06 PM1 replyview on HN

Runs fast on my Mac - ~100 tokens/second - but it's a bit of an over-thinker. It sketched out four different SVGs in the reasoning trace before returning a (bad) pelican riding a bicycle: https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

I used LM Studio and this model file: https://lmstudio.ai/models/nvidia/nemotron-3.5-lightning

I got a pretty solid (and reasonably fast) result for this simply coding agent activity (with simonw/llm-coding-agent):

  llm code -m lmstudio/nvidia/nemotron-3.5-lightning \
    'how does auth work?'
https://gist.github.com/simonw/a8741f79280cedc86bcb8d90edfb4... - took just under a minute.

Replies

EchoVoicytoday at 9:22 PM

>~100 tokens/second That sounds great to me!

>Runs fast on my Mac What specifications (CPU/RAM)?