The fact it's still Jan 2025 is weird to me. Have they not have a successful pretrain in over a year?
They likely won’t have a full pretrain for awhile. Just like everyone else, the name of the game now is to finetune existing models.
alt Hacker News
They likely won’t have a full pretrain for awhile. Just like everyone else, the name of the game now is to finetune existing models.