logoalt Hacker News

littlestymaaryesterday at 5:03 PM1 replyview on HN

If what you refer to by “on demand training ” is fine tuning, it's going to be much more efficient on a small model than a big one.


Replies

red75primeyesterday at 6:36 PM

LoRA can work with big models. But I mean sample-efficient RL.