Transformer Lens

Creator

Creator

Seonglae Cho

Created

Created

2024 Apr 8 16:18

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Apr 21 15:22

Refs

Refs

TransformerLens

neelnanda-io • Updated 2024 Apr 7 21:35

Transformer Lens Tools

Transformer Lens Usages

Transformer Lens Hook

Transformer Lens Utils

TransformerLens 2.0

Transformer Lens Patching

How to use

TransformerLens Quick Reference

TranformerLens is a Python library for Mechanistic Interpretability. It’s got some great tutorials… but they are all kinda verbose. Here’s a cheatsheet of all the common things yo…

TransformerLens Quick Reference

https://www.boristhebrave.com/2025/03/29/transformerlens-quick-reference/

TransformerLens Quick Reference

Cons

Quantization and not flash attention not supported which cause more memory

Supported model

Model Properties Table - TransformerLens Documentation

https://transformerlensorg.github.io/TransformerLens/generated/model_properties_table.html

Recommendations

//////////