diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index 00c0f15faa5..a315f267d32 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -87,6 +87,10 @@ We recommend you to use our prebuilt Docker image to start your development work
   python setup.py develop
   ```
 
+### Additional steps for GPU
+
+Please refer to this [guide](https://github.com/pytorch/xla/blob/master/docs/gpu.md#develop-pytorchxla-on-a-gpu-instance-build-pytorchxla-from-source-with-gpu-support).
+
 ## Before Submitting A Pull Request:
 
 In `pytorch/xla` repo we enforce coding style for both C++ and Python files. Please try to format