v0.0.5
Released on November 29, 2019.
Featured
@skippable
for efficient skip connections. With this interface, GPipe
copies skip tensors directly to the destination device.
Improvements
- Checkpointing deterministically handles randomness managed by PyTorch.
balance_by_size()
analyzes parameters as well.
Breaking Changes
- Moved
torchgpipe_balancing
module totorchgpipe.balance
. - Redesigned interface of
balance_by_time()
andbalance_by_size()
.