logoalt Hacker News

xienzetoday at 11:50 AM0 repliesview on HN

You likely still wouldn't be able to figure that out even if you had a percent usage view available. Will your request take 1K tokens or 10K? Who knows! That's the magic of non-deterministic black boxes.