[Doc][Neuron] add note to neuron documentation about resolving triton…

… issue (vllm-project#9257) Signed-off-by: omrishiv <[email protected]>
KuntaiDu · Oct 10, 2024 · 3fbcf1a · 3fbcf1a
1 parent 02293c1
commit 3fbcf1a
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/docs/source/getting_started/neuron-installation.rst b/docs/source/getting_started/neuron-installation.rst
@@ -27,6 +27,10 @@ Installation steps:
 
 .. _build_from_source_neuron:
 
+.. note::
+
+    The currently supported version of Pytorch for Neuron installs `triton` version `2.1.0`. This is incompatible with vLLM >= 0.5.3. You may see an error `cannot import name 'default_dump_dir...`. To work around this, run a `pip install --upgrade triton==3.0.0` after installing the vLLM wheel.
+
 Build from source
 -----------------