There's a bunch of details regarding LLMs and copyright, but I don't see how
> They should be forced to publicly release the books as an Ebook.
would be reasonable in any way? The books aren't theirs to release publicly. If I brought a copy of any given movie on DVD, ripped it and used it to train my own "LLM" located at /dev/null, should I then be allowed (or even forced) to release the movie publicly for anyone to watch for free?
The alternative (throwing books away for no good reason) isn't much more reasonable.
We’re in a brave new world now. If theirs reason to believe your destroying the last copy of a book( or another copy isn’t easy to obtain) then you should make a copy of it available.
Set up a compensation fund for the rights holders. Anything is better than culture literally being sucked into the void.