logoalt Hacker News

erutoday at 6:45 AM1 replyview on HN

How do you know this? How would you falsify this hypothesis?


Replies

maplethorpetoday at 8:13 AM

You could train an LLM on a dataset that intentionally excludes certain data, and see if it is able to extrapolate outside of its dataset and come up with those excluded items independently.

For example, remove all code from your training data, and then see if the model can code regardless.

show 1 reply