The chip is designed to run models with 20 billion to 100 billion parameters (approximately 3 billion to 20 billion active parameters)

Doesn't seem like 100B dense models are even on the table, only MoE models. Kinda misleading.