alt Hacker NewsIf anyone wishes to see the future. A fast LLM is quite eye-opening. I think chatjimmy uses Talaas' chips where models are hardcoded into the silicon.
Replies
flyingjoe • today at 8:56 AM
Thanks, I didn't know that one! Very impressive speed although quality seems very bad
➕ show 1 reply
Yea, is almost "scary fast" in a sense... the amount of compute you can do in parallel one one of those chips is amazing. hopefully they get their next chip completed as that will be a lot more useful for general workloads. I think the current one is based on llama3.
*corrected llama version to 3