Uniform Quantization

Creator
Creator
Seonglae Cho
Created
Created
2023 Oct 29 4:29
Editor
Edited
Edited
2023 Oct 29 4:58
Refs
Refs
All quantization bins are equally-sized. However, unless the values are uniformly distributed, uniform quantization is not optimal. Unfortunately, neural network weights are not uniform but rather have bell-shaped distributions, which is why non-uniform quantization is often used
 
 
 
 
 
 
 
 
 

Recommendations