zstd

Creator
Creator
Seonglae Cho
Created
Created
2023 Oct 4 12:40
Editor
Edited
Edited
2025 May 26 22:26
Refs
Refs
ZLib

Zstandard

A lossless data compression algorithm developed by Yann Collet at Facebook
In Hadoop/Impala environments,
Snappy
was the default choice due to its "low CPU usage and fast speed" requirements. However, as storage space grew to tens of TB~PB, "compression ratio" became crucial. Now,
zstd
is becoming the new standard as it creates 20-50% smaller files at similar speeds.
notion image
notion image
 
 
 
 
 

Recommendations