alt Hacker NewsI just want to know if my next prompt is about to eat shit at the last token. The number of times it like half works on something and falls apart halfway through.
I just want to know if my next prompt is about to eat shit at the last token. The number of times it like half works on something and falls apart halfway through.
You likely still wouldn't be able to figure that out even if you had a percent usage view available. Will your request take 1K tokens or 10K? Who knows! That's the magic of non-deterministic black boxes.