SAE Lens

Load from HF

from sae_lens.sae import SAE

sae, cfg_dict, sparsity = SAE.from_pretrained(
    'jbloom/GPT2-Small-SAEs-Reformatted',
    'blocks.11.hook_resid_post',
    device=device
)

Pretrained List

Supported SAEs - SAE Lens

Docs for Sparse Autoencoder Training and Analysis Library

https://jbloomaus.github.io/SAELens/sae_table/