Texonom
Texonom
/
Computing
Computing
/Computing Theory/Information Theory/Cryptography/Encoding/Data Compression/File Archiving/
zstd
Search

zstd

Creator
Creator
Seonglae Cho
Created
Created
2023 Oct 4 12:40
Editor
Editor
Seonglae Cho
Edited
Edited
2025 May 26 22:26
Refs
Refs
ZLib
zstd
facebook • Updated 2024 Feb 4 8:3

Zstandard

A lossless data compression algorithm developed by Yann Collet at Facebook
In Hadoop/Impala environments,
Snappy
was the default choice due to its "low CPU usage and fast speed" requirements. However, as storage space grew to tens of TB~PB, "compression ratio" became crucial. Now,
zstd
is becoming the new standard as it creates 20-50% smaller files at similar speeds.
notion image
notion image
 
 
 
Zstandard - Real-time data compression algorithm
Zstandard is a fast compression algorithm, providing high compression ratios. It also offers a special mode for small data, called dictionary compression. The reference library offers a very wide range of speed / compression trade-off, and is backed by an extremely fast decoder (see benchmarks below). Zstandard library is provided as open source software using a BSD license. Its format is stable and published as IETF RFC 8878.
https://facebook.github.io/zstd/
 
 

Backlinks

Storage File FormatSnappyFile Archiving

Recommendations

Texonom
Texonom
/
Computing
Computing
/Computing Theory/Information Theory/Cryptography/Encoding/Data Compression/File Archiving/
zstd
Copyright Seonglae Cho