logoalt Hacker News

typonyesterday at 9:34 PM1 replyview on HN

DinoV3 paper: https://arxiv.org/pdf/2508.10104#page=36

"we use a rough estimate of a total 9M GPU hours"

From CoreWeave, at current prices (~$2.46/hr spot to ~$6.16/hr on demand) would correspond to $22M–$55M.

The dataset is really where the cost is though - they used LVD-1689M - 1.6B images of curated web data from roughly 17B instagram images. This probably cost a huge amount of hours in human annotation, compute for algorithmic filtering, etc and not to mention probably a 20-50 person team working on this model.

You might want to change assumptions about how expensive these models are.


Replies

vatsachaktoday at 12:59 AM

Thanks for the correction on the order of magnitude for the whole training process.

The 9M GPU hours includes the DINO v2 inference used in order to curate the data set.

The final training run used like 300000 dollars of compute.

Unfortunately we don't know how much RLVR + Agent training costs these companies. I'm just gonna say it's in the hundreds of millions, because they are supposedly making billions of profit on inference yet making billion dollar losses