logoalt Hacker News

wrs • today at 7:59 PM • 0 replies • view on HN

At first I thought tacit knowledge would be a differentiator: LLMs are trained on writing, so they can’t learn things that have never been written down. But tacit knowledge is exactly what reinforcement learning post-training is about. So (just as with humans) the limitation is in providing a rich enough environment, with good enough feedback, to train in the tacit knowledge.