logoalt Hacker News

dfdydx • today at 8:51 PM • 0 replies • view on HN

Your phrasing (_observed_ scaling _part of_ some equation) might indicate you assume / think there’s some theoretical equation that relate intelligence to those parameters and the we observe the data to confirm it. As far as I know, there isn’t - it’s purely empirical curve fitting. Train a model with different amount of compute / data / parameters, measure performance, fit curve.