logoalt Hacker News

zackangeloyesterday at 8:15 PM2 repliesview on HN

just added 8 more H200s to the cluster, if you (or anyone else) runs into issues please feel free to drop me a message: zack at mixlayer.com


Replies

danielklnsteinyesterday at 8:26 PM

Works much better now! Got 103.9 tok/s, not quite 200 - but still amazing! Thanks for sharing

show 1 reply
danielklnsteinyesterday at 8:32 PM

FYI, I might be missing something but I think your billing system might not be working well - I'm not seeing any indication in the UI that my usage is being deducted from the $5 of free credits.

show 1 reply