Skip to content

PyTorch/XLA 1.8 release
Compare
Choose a tag to compare
@zcain117 zcain117 released this 04 Mar 23:45
v1.8.0
f2f8f44
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Summary

Cloud TPUs now support the PyTorch 1.8 release, via PyTorch/XLA integration. The release has daily automated testing for the supported models: Torchvision ResNet, FairSeq Transformer and RoBERTa, HuggingFace GLUE and LM, and Facebook Research DLRM.

This release focused on making PyTorch XLA easier to use and debug. See below for a list of new features.

New Features

  • Enhanced usability:
    • Profiler tools to help you pinpoint the areas where you can improve the memory usage or speed of your TPU models. The tools are ready to use; check out our main README for some upcoming tutorials.
    • Simpler error messages (#2771)
    • Less log spam using TPU Pods (#2662)
    • Able to view images in Tensorboard (#2679)
  • TriangularSolve (#2498) (example)
  • New ops supported by PyTorch/XLA:

Bug Fixes

  • Crashing while using dynamic shapes (#2602)
  • all_to_all crashing on TPU pods (#2601)
  • SiLU fix (#2721)
Assets 2
Loading