logoalt Hacker News

vfornotoday at 10:41 AM1 replyview on HN

Ho thanks for the comment. Verification does not depend on temperature. Expert execution is deterministic (pure matmul). LUMABRI_VERIFY=N re-runs N% of the calls on a second replica and requires byte-identical output. Temperature (and sampling) happens only on the chatter, after the experts return their activations. So it can be any value (0, 0.7, 1.2…) without affecting the verification contract.


Replies

stymaartoday at 11:25 AM

> Expert execution is deterministic (pure matmul).

Isn't that only true in theory but wrong in practice due to floating points?