alt Hacker NewsI tried in your playground and got 14.2 tok/s?
Replies
zackangelo • yesterday at 8:15 PM
just added 8 more H200s to the cluster, if you (or anyone else) runs into issues please feel free to drop me a message: zack at mixlayer.com
➕ show 2 replies
I tried in your playground and got 14.2 tok/s?
just added 8 more H200s to the cluster, if you (or anyone else) runs into issues please feel free to drop me a message: zack at mixlayer.com
apologies we just got a sudden burst of new users and traffic, it's scaling up now.