From a5f2e96eee0e949c3b4e74a84d89bd8de319260c Mon Sep 17 00:00:00 2001
From: omrishiv <327609+omrishiv@users.noreply.github.com>
Date: Thu, 10 Oct 2024 11:26:32 -0700
Subject: [PATCH] add note to neuron documentation about resolving triton issue

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
---
 docs/source/getting_started/neuron-installation.rst | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/docs/source/getting_started/neuron-installation.rst b/docs/source/getting_started/neuron-installation.rst
index a9ed4d7fa2cd7..ec99fc013057b 100644
--- a/docs/source/getting_started/neuron-installation.rst
+++ b/docs/source/getting_started/neuron-installation.rst
@@ -27,6 +27,10 @@ Installation steps:
 
 .. _build_from_source_neuron:
 
+.. note::
+
+    The currently supported version of Pytorch for Neuron installs `triton` version `2.1.0`. This is incompatible with vLLM >= 0.5.3. You may see an error `cannot import name 'default_dump_dir...`. To work around this, run a `pip install --upgrade triton==3.0.0` after installing the vLLM wheel.
+
 Build from source
 -----------------