logoalt Hacker News

ACCount37yesterday at 9:52 PM0 repliesview on HN

By now, model lifetime inference compute is >10x model training compute, for mainstream models. Further amortized by things like base model reuse.