pytorch_pfn_extras.nn.parallel.distributed#

Functions

pytorch_pfn_extras.nn.parallel.distributed.contextmanager(func)

@contextmanager decorator.

pytorch_pfn_extras.nn.parallel.distributed.get_foreach_wrapper()

pytorch_pfn_extras.nn.parallel.distributed.record(tag)

Classes

pytorch_pfn_extras.nn.parallel.distributed.DistributedDataParallel(module)

Module for distributed data parallelism

pytorch_pfn_extras.nn.parallel.distributed.OrderedDict

Dictionary that remembers insertion order

pytorch_pfn_extras.nn.parallel.distributed.TypeVar(...)

Type variable.

pytorch_pfn_extras.nn.parallel.distributed.Variable

pytorch_pfn_extras.nn.parallel.distributed.record_function(name)

Context manager/function decorator that adds a label to a code block/function when running autograd profiler.