alt Hacker NewsThe moat is GPUs/TPUs, ram and compute. When you need $200k of compute to run the frontier models, you are likely to be renting access to generate your tokens.
Replies
lisplist • yesterday at 9:38 PM
Probably close to $1M+ if frontier models are truly 5T and above params.
Current RAM is no moat. Upcoming Compute-in-RAM is. And nobody has that built up at scale yet. So, while a moat might become possible, we only have yesteryear's hardware as "moat".