Looks similar to OpenZL ( https://openzl.org/ )
"OpenZL takes a description of your data and builds from it a specialized compressor optimized for your specific format."
Honestly, Openzl looks even cooler! It would be cool to have it integrated with parquet and avro encoders. If I understand correctly the compressed files should be decompressable with standard tools.
Honestly, Openzl looks even cooler! It would be cool to have it integrated with parquet and avro encoders. If I understand correctly the compressed files should be decompressable with standard tools.