>Ultimately, with data that already contains interpretation, no matter how much you repeat the learning, it just becomes an encyclopedia that only explores within human knowledge, repeating predictions within human interpretation. So I wonder if we actually need a different encoder that interprets raw data—not based on human interpretation.

That will still not create anything new-new, just more new, still dound by just being "an encyclopedia that only explores within the universe" at best.