> If only there were some system that could start from some sparse and noisy observations and weave together a plausible completion...

Humans?