alt Hacker NewsChinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.
Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.
If that is the case, it means one thing only - US labs don't have moat whatsoever and their expectation to have trillion dollar valuation is just laughable.