logoalt Hacker News

poilcntoday at 5:45 AM1 replyview on HN

Nice. But these tests raise a question what results are reproducible, the final visual, time, tool calling or it's mostly noise. Like, have you tried same combination or model and harness multiple times?


Replies

alvins82today at 6:13 AM

I have on Qwen3.8 27B. Results are close enough across multiple runs.

show 1 reply