logoalt Hacker News

ACCount39 • today at 3:37 PM • 0 replies • view on HN

No room - or is there?

FractalDB proves that "synthetic data useful for training AI" can be produced by a very small program.

There is "no room" in DNA for a full dataset, or a full snapshot of model weights. But there's plenty of room for "this one little trick cuts the data required to learn a desirable thing X in half" reproduced thousands of times for different X. Low Kolmogorov complexity, but high performance gains.