Skip to content

Commit

Permalink
#5337: Update Mistral-7B CI tests
Browse files Browse the repository at this point in the history
  • Loading branch information
mtairum committed Jun 5, 2024
1 parent 5094e68 commit e816db1
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 6 deletions.
4 changes: 2 additions & 2 deletions models/demos/wormhole/mistral7b/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,12 +54,12 @@ Mistral-7B is running on a single chip. If you are running on a T3000 please set

```
# Run the demo with a pre-written batch of 32 user prompts:
pytest --collect-only models/demos/wormhole/mistral7b/demo/demo.py::test_demo[general_weights]
pytest models/demos/wormhole/mistral7b/demo/demo.py::test_demo[general_weights]
```

We also provide an input file with 32 user question-prompt for instruct weights (don't forget to update your env flags to the correct instruct weights folder):
```
pytest --collect-only models/demos/wormhole/mistral7b/demo/demo.py::test_demo[instruct_weights]
pytest models/demos/wormhole/mistral7b/demo/demo.py::test_demo[instruct_weights]
```

Both input files are provided inside `models/demos/wormhole/mistral7b/demo/`.
Expand Down
2 changes: 1 addition & 1 deletion tests/scripts/run_performance.sh
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ run_perf_models_llm_javelin() {
env pytest models/demos/mamba/tests -m $test_marker
fi

env WH_ARCH_YAML=wormhole_b0_80_arch_eth_dispatch.yaml pytest models/demos/wormhole/mistral7b/tests -m $test_marker # -> hanging: issue #7540
env pytest models/demos/wormhole/mistral7b/tests -m $test_marker

## Merge all the generated reports
env python models/perf/merge_perf_results.py
Expand Down
4 changes: 2 additions & 2 deletions tests/scripts/single_card/nightly/run_wh_b0_only.sh
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,6 @@ env pytest models/demos/mamba/tests/test_mamba_demo.py
env pytest models/demos/wormhole/mistral7b/tests/test_mistral_embedding.py
env pytest models/demos/wormhole/mistral7b/tests/test_mistral_rms_norm.py
env pytest models/demos/wormhole/mistral7b/tests/test_mistral_mlp.py
env WH_ARCH_YAML=wormhole_b0_80_arch_eth_dispatch.yaml pytest models/demos/wormhole/mistral7b/tests/test_mistral_attention.py
env WH_ARCH_YAML=wormhole_b0_80_arch_eth_dispatch.yaml pytest models/demos/wormhole/mistral7b/tests/test_mistral_decoder.py
env pytest models/demos/wormhole/mistral7b/tests/test_mistral_attention.py
env pytest models/demos/wormhole/mistral7b/tests/test_mistral_decoder.py
#env WH_ARCH_YAML=wormhole_b0_80_arch_eth_dispatch.yaml pytest models/experimental/functional_unet/tests
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ export WH_ARCH_YAML=wormhole_b0_80_arch_eth_dispatch.yaml
pytest --disable-warnings -q -s --input-method=cli --cli-input="YOUR PROMPT GOES HERE!" models/demos/wormhole/falcon7b/demo_wormhole.py::test_demo[user_input0-default_mode_stochastic]

# working on both
pytest --disable-warnings -q -s --input-method=cli --cli-input="YOUR PROMPT GOES HERE!" models/demos/wormhole/mistral7b/demo/demo.py
pytest models/demos/wormhole/mistral7b/demo/demo.py::test_demo[instruct_weights]

# working on both
pytest --disable-warnings -q -s --input-method=cli --cli-input="YOUR PROMPT GOES HERE!" models/demos/mamba/demo/demo.py
Expand Down

0 comments on commit e816db1

Please sign in to comment.