Also... One of the only industries/products where unusable product/seevice (token / context burned) is neither refunded let alone even acknowledged. I wonder how many millions of dollars of inference have been stolen during these outages? First you lose the work in flight, then you lose the time, and finally you lose the token burn for a second time. What a fantastic time to not have any regulations if you're rich and greedy!
alt Hacker News
Also... One of the only industries/products where unusable product/seevice (token / context burned) is neither refunded let alone even acknowledged. I wonder how many millions of dollars of inference have been stolen during these outages? First you lose the work in flight, then you lose the time, and finally you lose the token burn for a second time. What a fantastic time to not have any regulations if you're rich and greedy!