alt Hacker NewsYou don't think an LLM can perform tasks not in its training data?
Replies
krona • today at 8:17 PM
Not one which can easily be represented as an interpolation of other tasks it was trained on.
You don't think an LLM can perform tasks not in its training data?
Not one which can easily be represented as an interpolation of other tasks it was trained on.
I don't think it can whistle while chewing gum, no.
I think it can patch together components of tasks represented in its training data to do demonstrably new things, yes, which does count as "perform tasks not in its training data" with the limitation that some form of the task must be present. Example: writing an ode to a sales lead for a job well done in 2032 for the first quarter. Odes exist, the concept of sales performance exist, good job performance, and notions of time. Stringing those together are good examples of interpolation but not extrapolation, as it were.