Understanding Positional Features in Layer 0 SAEs — LessWrong
This is an informal research note. It is the result of a few-day exploration into positional SAE features conducted as part of Neel Nanda’s training…
https://www.lesswrong.com/posts/ctGeJGHg9pbc8memF/understanding-positional-features-in-layer-0-saes
