Seonglae ChoEager mode is easier to use, more suitable for ML researchers, and hence is the default mode of execution
PyTorch executes operations line-by-line without a wholistic view of the code. It has the benefit of flexibility and easier to debug at the cost of many optimization opportunities.
Optimizing Production PyTorch Models’ Performance with Graph Transformations
1. Introduction
https://pytorch.org/blog/optimizing-production-pytorch-performance-with-graph-transformations/