Skip to content

Commit

Permalink
Update metrics.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kashyap7x authored Feb 20, 2024
1 parent 271c5b1 commit 526e9ac
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,8 +18,8 @@ To evaluate the PDM score for an agent you can run:
cd $NAVSIM_DEVKIT_ROOT/scripts/
./run_pdm_score_evaluation.sh
```
**Note: You have to adapt the variables `LOG_PATH` so that it points to the logs (annotations), `METRIC_CACHE_PATH` so that it points to the metric-cache and `OUTPUT_DIR` so that it points to a directory where the evaluation csv will be stored**
**Note: You have to adapt the variables `LOG_PATH` so that it points to the [logs (annotations)](https://github.com/autonomousvision/navsim/blob/main/docs/install.md#1-download-the-demo-data), `METRIC_CACHE_PATH` so that it points to the [metric cache](https://github.com/autonomousvision/navsim/blob/main/docs/cache.md#understanding-the-data-format-and-classes) and `OUTPUT_DIR` so that it points to a directory where the evaluation csv will be stored**

By default, this will generate an evaluation csv for a simple constant velocity planning baseline. You can modify the script to evaluate your own planning agent.
By default, this will generate an evaluation csv for a simple constant velocity [planning baseline](https://github.com/autonomousvision/navsim/blob/main/docs/agents.md#output). You can modify the script to evaluate your own planning agent.
For instance, you can add a new config for your agent under `$NAVSIM_DEVKIT_ROOT/navsim/navsim/planning/script/config/pdm_scoring/agent/my_new_agent.yaml`.
Then, running your own agent is as simple as adding an override `agent=my_new_agent` to the script.

0 comments on commit 526e9ac

Please sign in to comment.