Skip to content

Latest commit

 

History

History
3 lines (3 loc) · 307 Bytes

README.md

File metadata and controls

3 lines (3 loc) · 307 Bytes

This is the NOWLAB fork of upstream PyTorch. The key features we've added are:

  1. Support for building PyTorch's distributed module with any [CUDA/ROCm]-aware MPI library including NOWLAB's MVAPICH2-GDR
  2. Support for MPI + fp16 communication operations