It should also be noted that this kind of fitting is extremely closely related to integration or in other words calculating the mean.

By using the "right" kind of polynomial basis you can get a polynomial approximation which also tells you the mean and variance of the function under a random variable.