logoalt Hacker News

zozbot234 • today at 5:29 PM • 1 reply • view on HN

Is there any evidence that Hy4 proper is a new architecture compared to Hy4 Preview? Mind you, the Preview page explicitly says "we're not even done with pretraining, let alone model fine-tuning".


Replies

segmondy • today at 5:56 PM

Oh ok, I see what you mean, you are just comparing them by weight. In that case, it tracks that K3.1 will have more knowledge. It's the same architecture. I'm just saying that for how large K3.1 is, intelligence by weight, it's not crushing DSV4.1 or Hy4