logoalt Hacker News

saberienceyesterday at 9:12 PM4 repliesview on HN

Who's the intended user for this?

Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?

Is it a competitor to LMStudio?


Replies

danielhanchenyesterday at 10:32 PM

You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!

We're complimentary to LM Studio - they have a great tool as well!

show 1 reply
huydotnetyesterday at 10:20 PM

you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.

show 1 reply
lastdongyesterday at 9:42 PM

From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”

mlnjyesterday at 9:40 PM

I am unaware lm studio is being used for fine tuning. I believe it only does inference.

Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy.

Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.

show 1 reply