add note to neuron documentation about resolving triton issue

Signed-off-by: omrishiv <[email protected]>
vllm-project · Oct 10, 2024 · a5f2e96 · a5f2e96
1 parent d5fbb87
commit a5f2e96
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/docs/source/getting_started/neuron-installation.rst b/docs/source/getting_started/neuron-installation.rst
@@ -27,6 +27,10 @@ Installation steps:
 
 .. _build_from_source_neuron:
 
+.. note::
+
+    The currently supported version of Pytorch for Neuron installs `triton` version `2.1.0`. This is incompatible with vLLM >= 0.5.3. You may see an error `cannot import name 'default_dump_dir...`. To work around this, run a `pip install --upgrade triton==3.0.0` after installing the vLLM wheel.
+
 Build from source
 -----------------