logoalt Hacker News

dllulast Sunday at 9:07 PM4 repliesview on HN

You can think of it as: linear regression models only noise in y and not x, whereas ellipse/eigenvector of the PCA models noise in both x and y.


Replies

analog31last Sunday at 9:33 PM

That brings up an interesting issue, which is that many systems do have more noise in y than in x. For instance, time series data from an analog-to-digital converter, where time is based on a crystal oscillator.

show 2 replies
CGMthrowawaylast Monday at 1:40 AM

So when fitting a trend, e.g. for data analytics, should we use eigenvector of the PCA instead of linear regression?

show 1 reply
10000truthslast Monday at 1:17 AM

Is there any way to improve upon the fit if we know that e.g. y is n times as noisy as x? Or more generally, if we know the (approximate) noise distribution for each free variable?

show 2 replies
scotty79last Monday at 3:46 PM

It might be cool to train neural network by minimizing error with assumption there's noise on both inputs and outputs.