logoalt Hacker News

dghlsakjgtoday at 4:05 AM1 replyview on HN

I know everyone wants to crap all over these setups that are impractical, but this is how progress happens.

People will keep plugging away at this and figure out how to avoid wearing the hard drive, how to make it run faster, custom hardware buses etc.

Keep going! I personally can't wait for the day when a 1t param model runs off a $200 SSD instead of a $50k rack of Nvidia chips.


Replies

arjietoday at 4:20 AM

Haha 1T on $50k might be a bit hopeful, mate, even at FP8. But I too am hopeful.

show 2 replies