Skip to content

v0.0.5

Compare
Choose a tag to compare
@sublee sublee released this 29 Nov 10:04
· 20 commits to master since this release

Released on November 29, 2019.

Featured

@skippable for efficient skip connections. With this interface, GPipe copies skip tensors directly to the destination device.

Improvements

  • Checkpointing deterministically handles randomness managed by PyTorch.
  • balance_by_size() analyzes parameters as well.

Breaking Changes

  • Moved torchgpipe_balancing module to torchgpipe.balance.
  • Redesigned interface of balance_by_time() and balance_by_size().