logoalt Hacker News

stymaar • today at 1:09 PM • 0 replies • view on HN

A base model is what you get just from next token prediction training. Think GPT-2/3 but bigger.

Withtout RLHF, instruction-following training, or RLVR to develop reasoning.