From c5073c0e2cd7d354fd2d4c72daa1dd79ab44fe83 Mon Sep 17 00:00:00 2001 From: pritam Date: Tue, 15 Sep 2020 16:45:01 -0700 Subject: [PATCH] Update dist_overview with additional information. Summary: 1) Added DDP + RPC tutorial. 2) Added a pointer to PT Distributed CONTRIBUTING.md. Test Plan: Verified by loading the page locally. Reviewers: sentinel Subscribers: Tasks: Tags: --- beginner_source/dist_overview.rst | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/beginner_source/dist_overview.rst b/beginner_source/dist_overview.rst index bc9f7fe6bf0..f2878fb3ba9 100644 --- a/beginner_source/dist_overview.rst +++ b/beginner_source/dist_overview.rst @@ -195,3 +195,13 @@ RPC Tutorials are listed below: `@rpc.functions.async_execution `__ decorator, which can help speed up inference and training. It uses similar RL and PS examples employed in the above tutorials 1 and 2. +5. The `Combining Distributed DataParallel with Distributed RPC Framework <../advanced/rpc_ddp_tutorial.html>`__ + tutorial demonstrates how to combine DDP with RPC to train a model using + distributed data parallelism combined with distributed model parallelism. + + +PyTorch Distributed Developers +------------------------------ + +If you'd like to contribute to PyTorch Distributed, please refer to our +`Developer Guide `_.