alt Hacker NewsBy early 2028, major players like Intel, AMD, QC will ship accelerators in consumer laptops capable of running ~1T MoE models at ~100 tok/s
Replies
kennywinker • today at 8:32 PM
Unless there are major improvements to how much hardware it takes to run a 1T model, this is deeply unrealistic. First because why release hardware that puts your biggest customers (data centers) out of business. Second because as I understand it the data centers have bought up all the high end chip production capacity for at least the next year and unless the bubble pops that'll continue for a while.
➕ show 1 reply
Literally the only way this is going to happen is if aliens come to earth and gift us some amazing technology.