[N] PyTorch 1.3 supports Google Cloud TPUs
As announced at the PyTorch Developer Conference earlier this month, there is now (public alpha) support for Cloud TPUs in PyTorch 1.3.
The repo https://github.com/pytorch/xla links to a few Google Cloud blog posts for example tutorials that should be useful to dive in:
Training FairSeq Transformer on Cloud TPU using PyTorch
Training Resnet50 on Cloud TPU with PyTorch
Training PyTorch models on Cloud TPU Pods
Does this mean we can use Google Cloud TPUs for PyTorch 1.3, but not yet for TensorFlow 2.0?
submitted by /u/milaworld
[link] [comments]