logoalt Hacker News

doomroot13 • today at 8:17 PM • 1 reply • view on HN

It seems they trained from scratch: https://microsoft.ai/news/frontier-pre-training-at-microsoft...


Replies

bensyverson • today at 8:41 PM

Owning the iron has got to be a massive advantage. It's interesting that the advantage has so far been pretty theoretical, but based on these benchmarks, it may be starting to pay off. It has to be hard to hire in the talent to train these models (even if you're Microsoft) when you're competing with established labs.