They’re not supposed to be storing a copy. What they’re doing is destroying their copy after training a model on it.
No, US copyright law allows them to keep a single digital copy. The hypothetical issue is with them maintaining two copies, one digital and one physical, when they only purchased one.
They're absolutely keeping the digitized copies. They're not going to just train a single model.