Speaking of Runpod.io GPU availability, it is definitely increased in the past 6 months, getting 80Gb+ vram on demand takes few mins (not 5-6 hours like it used to be) at 1-3 usd an hour rate ... which made me thought a week ago - finally GPU bubble peak arrived

Another thought - i want to audit the actual usage of GPU like actual efficient inference time not billed one without relying on "trust me bro" billing. Especially on AWS. Had no trust issue with Runpod.io

Any effective inference audit ideas are appreciated