alt Hacker NewsIs it actually that hard to make good models or is it just about the amount of resources you have to do training? (This is an actual question, I really don't know.) I'm sure it's not trivial but does it really take world class secret knowledge to build off of the known existing techniques? I feel like there's tons of low hanging fruit still to explore, and time and resources are the limiting factor.
Replies
>Is it actually that hard to make good models
Didn't take DeepSeek long. Or XAI to launch grok.
If they have a top team and the money then appears to be a matter of a year or two? And one startup mentioned is Japanese not Chinese so they won't be banned from buying US tech.
Not hard to be a fast follower. Lots of companies are ~6-9 months behind. Reaching the actual bleeding edge is much harder.
The gap between grok and Gemini to Claude and chatgpt suggests that yes it is that hard.