SPMD

PyTorch runs on XLA devices, like TPUs, with the torch_xla package. This document describes how to run your models on these devices.