> Where they'd get training data?

They generated it, and had a compiler compile it, and then had it examine the output. Rinse, repeat.