>"We also have a contract with AMD to get MI350X on MLPerf for Llama 405B training."

Anything to help AMD (and potentially other GPU/NPU/IPU etc. chip makers) catch up with NVidia/CUDA is potentially worth money, potentially worth a lot of money, potentially worth up to Billion$...

Why?

If we have

a) Market worth Billion$

and

b) A competitive race in that Market...

then

c) We have VALUE in anything (product, service, ?, ???) that helps any given participant capture more of that market than their competitors...

(AMD (and the other lesser known GPU/NPU/IPU etc. chip vendors) are currently lagging behind NVidia's CUDA AI market dominance -- so anything that helps the others advance in this area should, generally speaking, be beneficial for all technology users in general, and be potentially profitable (if the correct deals could be struck!) by those that have the skills to do such assisting...)

Anyway, wishing you well in your endeavors, Tinygrad!