is groq still using 6 racks to serve Llama3-70B or is that old news?
The new chip isn't out yet so that's the only thing they could be doing.
alt Hacker News
The new chip isn't out yet so that's the only thing they could be doing.