Seonglae ChoTransformer Lens Tools
Transformer Lens Usages
How to use
TransformerLens Quick Reference
TranformerLens is a Python library for Mechanistic Interpretability. It’s got some great tutorials… but they are all kinda verbose. Here’s a cheatsheet of all the common things yo…
https://www.boristhebrave.com/2025/03/29/transformerlens-quick-reference/
Cons
- Quantization and not flash attention not supported which cause more memory
Supported model
Model Properties Table - TransformerLens Documentation
https://transformerlensorg.github.io/TransformerLens/generated/model_properties_table.html