logoalt Hacker News

vonduryesterday at 2:48 PM1 replyview on HN

Isn't Amazon doing the same thing, making their own TPU's?


Replies

clayhacksyesterday at 4:34 PM

Yeah trainium and inferentia. They’re just not nearly as well supported on the software level. Google has already made sure this new generation will be supported by vllm, sglang, etc. Amazons chips barely support those and only multiple versions back. Super under invested in (at least on the open source side)

show 1 reply