Transformer Engine

Creator

Creator

Created

Created

2023 Nov 20 13:49

Editor

Editor

Edited

Edited

2024 Mar 9 15:12

Refs

Refs

Flash Attention


pip install git+https://github.com/NVIDIA/TransformerEngine.git@stable

Installation — Transformer Engine 1.0.0 documentation

Getting Started

https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/installation.html

Recommendations

//////