SAE Decoder Loss

Creator

Creator

Seonglae Cho

Created

Created

2025 Mar 13 17:23

Editor

Editor

Seonglae Cho

Edited

Edited

2025 May 20 18:46

Refs

Refs

SAE Feature Direction

SAE Feature Direction Loss

Tanh loss

Achieves Pareto-optimality by "minimizing feature activations while maintaining low output error"

Circuit Tracing: Revealing Computational Graphs in Language Models

We describe an approach to tracing the “step-by-step” computation involved when a model responds to a single prompt.

https://transformer-circuits.pub/2025/attribution-graphs/methods.html

Circuit Tracing: Revealing Computational Graphs in Language Models

Backlinks

SAE Feature SAE Loss

Recommendations

/////////////