Seonglae ChoGraph mode typically delivers higher performance and hence is heavily used in production
Optimizing Production PyTorch Models’ Performance with Graph Transformations
1. Introduction
https://pytorch.org/blog/optimizing-production-pytorch-performance-with-graph-transformations/