alt Hacker NewsAwesome breakdown! It really feels like a hyper-hyper parameter search + bug fixer.
I started looking at Kaggle again and autoresearch seems to converge to many of the solution vibes there.
Wild ensembles, squeezing a bit of loss out. More engineering than research IMO
For raw hyperparameter search, though, I would expect a proper Bayesian framework to be much better. Eg, vizier.