Transformer Engine

Creator

Creator

Seonglae Cho

Created

Created

2023 Nov 20 13:49

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Mar 9 15:12

Refs

Refs

Flash Attention

Installation — Transformer Engine 1.0.0 documentation

Getting Started

https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/installation.html

Recommendations

//////