logoalt Hacker News

sigmoid10yesterday at 10:44 PM2 repliesview on HN

GPT-4 came out 3 years ago and you can run comparable models for 1% of the cost nowadays. That is not 2x efficiency. That's two orders of magnitude in end-to-end compute efficiency.


Replies

danielparsonsyesterday at 10:56 PM

you're looking at nearly the entire curve of the tech's development. that's like saying lightbulbs became 99% more energy efficient and therefore will become another 99% more energy efficient. but most techs follow an S curve.

show 2 replies
swingboyyesterday at 10:52 PM

How do we know how much it costs? Or is this just based off the token pricing?

show 1 reply