alt Hacker NewsLive learning has actually been a pretty interesting idea in ML for a long time that i dont know why doesnt get more effort put into it. Probably cost. But itd be really cool to have an LLM that gets finetuned on your data and RLs from your HF everytime you ask it to do something and give it feedback
because it's not easy to identify exactly when to r/w memory accordingly, especially when you'd need to have an LLM decide when and if to do that
and to scale it in a way where you don't need a whole custom model loaded for 1 user (financially unviable)
just my immediate thoughts, could be wrong though.