This was tried many times in the past for images, even before LLMs.

https://imalogic.com/blog/2024/06/03/image-compression-decom...