Seonglae ChoMean max cosine similarity
[Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment Forum
We're thankful for helpful comments from Trenton Bricken, Eric Winsor, Noa Nabeshima, and Sid Black. …
![[Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment Forum](https://res.cloudinary.com/dq3pms5lt/image/upload/v1531267596/alignmentForum_favicon_o9bjnl.png)
https://www.alignmentforum.org/posts/z6QQJbtpkEAX3Aojj/interim-research-report-taking-features-out-of-superposition
![[Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment Forum](https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/z6QQJbtpkEAX3Aojj/hkdlcq7pmr7wnn63vi2h)
ML2R (mean L2 Ratio)
arxiv.org
https://arxiv.org/pdf/2501.14926