alt Hacker NewsSeems like this process itself should be incredibly amenable to automation. Here's 25 parameters, permute over them, perform this test on each loop.
But it sounds like there were other gremlins (like ulimit reverting itself) that would've thwarted automated testing.
Do you feel like there's a point where it would've made sense to automate?
Replies
einsteinx2 • today at 3:34 PM
That and I’m not sure why they rebooted the server every time instead of just changing the flags…
NooneAtAll3 • today at 3:08 PM
I think he did employ automation?
it's just that each run takes a long long time
I'm not really sure about that exactly, and the stream-of-Claude text doesn't lend a lot of confidence in the results, but running this with the command line driver wrapped in a scipy.optimize script seems like a faster and cleaner route to an accurate result.