The Training Example Lie Bracket

Was hoping for a tournament bracket of best lies found in training data :(

> An ideal machine learning model would not care what order training examples appeared in its training process. From a Bayesian perspective, the training dataset is unordered data and all updates based on seeing one additional example should commute with each other.

One of Andrew Gelman's favorite points to make about science 'as practiced' is that researchers fail to behave this way. There's a gigantic bias in favor of whatever information is published first.

Eventually ML folks will discover fiber bundles.

Could this be used for batch filtering?