Mean max cosine similarity [Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment ForumWe're thankful for helpful comments from Trenton Bricken, Eric Winsor, Noa Nabeshima, and Sid Black. …https://www.alignmentforum.org/posts/z6QQJbtpkEAX3Aojj/interim-research-report-taking-features-out-of-superpositionML2R (mean L2 Ratio)arxiv.orghttps://arxiv.org/pdf/2501.14926
Seonglae ChoSeonglae ChoSeonglae ChoSeonglae Cho![[Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment Forum](https://www.notion.so/image/https%3A%2F%2Fres.cloudinary.com%2Fdq3pms5lt%2Fimage%2Fupload%2Fv1531267596%2FalignmentForum_favicon_o9bjnl.png?table=block&id=1d5c3c96-247d-8030-af19-fbab9c6148f7&cache=v2)
![[Interim research report] Taking features out of superposition with sparse autoencoders — AI Alignment Forum](https://www.notion.so/image/https%3A%2F%2Fres.cloudinary.com%2Flesswrong-2-0%2Fimage%2Fupload%2Ff_auto%2Cq_auto%2Fv1%2FmirroredImages%2Fz6QQJbtpkEAX3Aojj%2Fhkdlcq7pmr7wnn63vi2h?table=block&id=1d5c3c96-247d-8030-af19-fbab9c6148f7&cache=v2)