logoalt Hacker News

bt1ayesterday at 10:04 PM0 repliesview on HN

This is most likely an inference serving problem in terms of capacity and latency given that Opus X and the latest GPT models available in the API have always responded quickly and slowly, respectively