Seonglae ChoThe architecture has separate for each layer while sharing only the latent dictionary for scaling, where : source layer-specific encoder, : target layer-specific decoder, : reconstructed layer activation from source latent.
Each input-output layer pair has its own encoder-decoder weight pair. Unlike cross-layer transcoders (Circuit Tracing), encoders are not shared; instead, layers share the same latent space, achieved through loss-based approximation.
This is solved through alignment via co-training, where an alignment loss is added during training to force the latents to match, causing them to converge to a shared latent space.
The original purpose is cross-layer mapping and feature alignment, but it can be used for various purposes such as model diffing and scaling transfer
Decoder sparsity loss
Crosscoders
2025 findings on analysis
For some feature learned by the crosscoder, the decoder writes much more strongly into one model than the other. Features that are exclusive to a single model also tend to be systematically more polysemantic and activate more densely than shared features, which the authors argue comes from competition over limited feature capacity. They support this with toy-model experiments: when the number of learnable features is much larger than the number of ground-truth features, the density gap disappears; but when it is comparable or smaller, exclusive features show roughly an order-of-magnitude higher activation frequency. The key driver is the crosscoder objective.
CrossCoder (2024)
with Cross fine-tuning model & scaling transferability by diffing within same architecture
BatchTopK crosscoder to prevent Complete Shrinkage and Latent Decoupling for chat model
Using Crosscoder for chat Model Diffing reveals issues with traditional L1 sparsity approaches: many "chat-specific features" are falsely identified because they are actually existing concepts that shrink to zero in one model during training. Most chat-exclusive latents are training artifacts rather than genuine new capabilities.
Complete Shrinkage → A shared concept where one model's decoder shrinks to zero. Latent Decoupling → The same concept is represented by different latent combinations in two models.
Using Top-K (L0-style) sparsity instead of L1 reduces false positives and retains only alignment-related features. Chat tuning effects are primarily not about capabilities themselves, but rather: safety/refusal mechanisms, dialogue format processing, response length and summarization controls, and template token-based control. In other words, it acts more like a shallow layer that steers existing capabilities.