logoalt Hacker News

Gigachad • yesterday at 11:26 PM • 0 replies • view on HN

One analogy I have heard is that distillation is like waterskiing, where the water skier seems to be moving at rapid pace and only just behind the boat, but that they aren't really expending any energy and if the boat slows down, so will they.

This seems to match what we are seeing where Chinese models from companies with only a tiny fraction of the compute are able to be hot on the heels of the frontier models.