logoalt Hacker News

pertymcpertyesterday at 9:34 PM1 replyview on HN

The models are non-deterministic. You can't just assume that because it did better before that it was on average better than before. And the variance is quite large.


Replies

zsoltkacsandiyesterday at 9:39 PM

No one talked about determinism. First it was able to do a task, second time not. It’s not that the implementation details changed.

show 1 reply