> Trained from scratch
How are they training without pirating the Z library corpus and all that?
I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text
alt Hacker News
I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text