To serve a frontier model you need a lot more than one GPU... at least 8. But for better efficiency they batch multiple requests on one server. So it is sort of a coincidence that it ends up roughly in 1 consumer GPU range. A different architecture (e.g. linear attention / RNN) could end up with more peak power usage.