Model Layer Scaling

Creator

Creator

Seonglae Cho

Created

Created

2025 Jan 12 15:51

Editor

Editor

Seonglae Cho

Edited

Edited

2026 Sep 30 18:46

Refs

Refs

Recursive Transformer

Residual Connection,
Layer Normalization,
Swish Function

Model Layer Scaling Techniques

Depth Up-Scaling

Recursive Transformer

Model Layer Optimization

https://arxiv.org/pdf/2203.00555

Latent Communication

Recursive Transformer

Looped Transformer (no hard evid)

The Specter Of Neuralese

https://www.astralcodexten.com/p/the-specter-of-neuralese

The Specter Of Neuralese

Backlinks

Autoregressive Model Parameter Estimation Model Layer Scaling Contrastive RL Reversing Transformer

Recommendations

//////