This tutorial introduces more advanced features of Fully Sharded Data Parallel (FSDP) as part of the PyTorch 1.12 release. To get familiar with FSDP, please refer to the FSDP getting started tutorial.
.. grid:: 2 .. grid-item-card:: :octicon:`mortar-board;1em;` What you will learn :class-card: card-prerequisites * PyTorch's Fully Sharded Data Parallel Module: A wrapper for sharding module ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results