Similar here, except I used Opus 4.8. I don't mind using cloud models to make code as long as I don't put actual private data into the model. And I can't run qwen 27b reliably at the moment, I need a better gpu.
It was pretty easy mode like this tbh, though you do need to know what you're doing. I use it with llama-server and openwebui.
I guess you can get it a lot more click to go with something like LM Studio though but I want to use it on a server and call upon its services from multiple sources.
alt Hacker News
Similar here, except I used Opus 4.8. I don't mind using cloud models to make code as long as I don't put actual private data into the model. And I can't run qwen 27b reliably at the moment, I need a better gpu.
It was pretty easy mode like this tbh, though you do need to know what you're doing. I use it with llama-server and openwebui.
I guess you can get it a lot more click to go with something like LM Studio though but I want to use it on a server and call upon its services from multiple sources.