Seonglae Chofor numerical stability
- load is faster than
.ptfile because this library avoids unnecessary copies by mapping
- no arbitrary code can be put into it.
매우 긴 시퀀스는 수치안정성 문제 있는데 그래서 Sequential Data 처리 작업에서 유용
softmax 함수를 계산할 때 입력값의 최댓값을 빼고 지수 함수를 계산하여 정규화함
Pytorch, Numpy, Tensorflow, Flax 지원
From
Safetensor Usages
🐶Safetensors audited as really safe and becoming the default
Audit shows that safetensors is safe and ready to become the default Hugging Face, in close collaboration with EleutherAI and Stability AI, has ordered an external security audit of the safetensors library, the results of which allow all three organizations to move toward making the library the default format for saved models. The full results of the security audit, performed by Trail of Bits, can be found here: Report. The following blog post explains the origins of the library, why these audit results are important, and the next steps.
https://blog.eleuther.ai/safetensors-security-audit/
