The rust-safetensors package
Safetensor implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).
Provides functions to read and write safetensors which aim to be safer
than their PyTorch counterpart. The format is 8 bytes which is an
unsized int, being the size of a JSON header, the JSON header refers the
dtype
the shape
and data_offsets
which are the offsets for the
values in the rest of the file.