Pickle files are probably still useful saving exploratory work, collaborating inside a company, and use inside a pipeline.
Safetensors is supposed to be the successor for distribution. I believe that it's the "safe" subset of pickle's data format.
The safetensors file format is a header length, JSON header, and serialized tensor weights. [1]
[1] https://github.com/huggingface/safetensors
The safetensors file format is a header length, JSON header, and serialized tensor weights. [1]
[1] https://github.com/huggingface/safetensors