SAE Feature Circuit

Each feature mutually increases the token probability, creating a feature loop which sometime breaks the model capability without repetition penalty (

Halting Problem)

Types

• Unicode prefix, suffix predictors (Tamil, Chinese)

Complex multi-node

Finite State Automata (HTML)