Transformer Engine

Creator

Creator

Seonglae Cho

Created

Created

2023 Nov 20 13:49

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Mar 9 15:12

Refs

Refs

TransformerEngine

NVIDIA • Updated 2023 Nov 20 9:27

Flash Attention


pip install git+https://github.com/NVIDIA/TransformerEngine.git@stable

Installation — Transformer Engine 1.0.0 documentation

Getting Started

https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/installation.html

Backlinks

AI Inference Huggingface accelerate undefined symbol:

Recommendations

//////