Graph mode typically delivers higher performance and hence is heavily used in production Optimizing Production PyTorch Models’ Performance with Graph Transformations1. Introductionhttps://pytorch.org/blog/optimizing-production-pytorch-performance-with-graph-transformations/