Seonglae ChoCodebook feature VQ-VAE
Residual Vector Quantization bottleneck 양자화된 벡터가 더 유의미한 정보만을 포함하도록
RQAE (Residual Quantization Autoencoder) Residual Vector Quantization (Stacked SAEs)
RQAE learns features hierarchically, by iteratively applying vector quantization on different subspaces of the residual stream of an LLM.
