logoalt Hacker News

yzhong94today at 6:22 PM0 repliesview on HN

Why was the time to first token slow? Was it because of the spin up time for containers? That was an issue for us when we were running on Google's Cloud Run. We switched to Blaxel and it's much faster now. The hibernate feature has been great for comment iteration.