Dynamic Quantization

Only the weights of the model are quantized ahead of time, while the activations are quantized on-the-fly during inference. Weights are statically quantized, but activations are dynamically quantized based on their actual runtime values.