rust-safetensors

The rust-safetensors package

Safetensor implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).

Provides functions to read and write safetensors which aim to be safer than their PyTorch counterpart. The format is 8 bytes which is an unsized int, being the size of a JSON header, the JSON header refers the dtype the shape and data_offsets which are the offsets for the values in the rest of the file.