Instead of selecting the top k activations for each individual sample, we select the top n × k activations across the entire batch of n samples,
BatchTopK
BatchTopK SAE
Creator
Creator
Seonglae ChoCreated
Created
2025 Jan 20 15:5Editor
Editor
Seonglae ChoEdited
Edited
2025 Oct 29 23:57Refs
Refs
iid