logoalt Hacker News

wolvoleotoday at 5:00 PM0 repliesview on HN

Similar here, except I used Opus 4.8. I don't mind using cloud models to make code as long as I don't put actual private data into the model. And I can't run qwen 27b reliably at the moment, I need a better gpu.

It was pretty easy mode like this tbh, though you do need to know what you're doing. I use it with llama-server and openwebui.

I guess you can get it a lot more click to go with something like LM Studio though but I want to use it on a server and call upon its services from multiple sources.