alt Hacker Newsdoes lora do a good job at teaching the model new things that werent in the training data?
without trillions of examples of following instructions at a million context length, im not convinced the behaviour is in the weights to begin with
does lora do a good job at teaching the model new things that werent in the training data?
without trillions of examples of following instructions at a million context length, im not convinced the behaviour is in the weights to begin with
No. Lora is for tuning behaviour and how the model applies what it learned in training. Teaching a model new facts is still expensive.