logoalt Hacker News

exe34today at 7:37 AM2 repliesview on HN

if that's the arguement for active learning, wouldn't it also apply in that case? it learns something and 5 minutes later my old prompts are useless.


Replies

t-writescodetoday at 9:56 AM

That depends on the goals of the prompts you use with the LLM:

* as a glorified natural language processor (like I have done), you'll probably be fine, maybe

* as someone to communicate with, you'll also probably be fine

* as a *very* basic prompt-follower? Like, natural language processing-level of prompt "find me the important words", etc. Probably fine, or close enough.

* as a robust prompt system with complicated logic each prompt? Yes, it will begin to fail catastrophically, especially if you're wanting to be repeatable.

I'm not sure that the general public is that interested in perfectly repeatable work, though. I think they're looking for consistent and improving work.

naaskingtoday at 2:03 PM

I don't think old prompts would become useless. A few studies have shown that prompt crafting is important because LLMs often misidentify the user's intent. Presumably an AI that is learning continuously will simply get better at inferring intent, therefore any prompts that were effective before will continue to be effective, it will simply grow its ability to infer intent from a larger class of prompts.