From 526e9acf85043539501d6bcffd92fc52a763f05e Mon Sep 17 00:00:00 2001 From: Kashyap Chitta Date: Tue, 20 Feb 2024 11:17:19 +0100 Subject: [PATCH] Update metrics.md --- docs/metrics.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/metrics.md b/docs/metrics.md index 8750f81..05198f1 100644 --- a/docs/metrics.md +++ b/docs/metrics.md @@ -18,8 +18,8 @@ To evaluate the PDM score for an agent you can run: cd $NAVSIM_DEVKIT_ROOT/scripts/ ./run_pdm_score_evaluation.sh ``` -**Note: You have to adapt the variables `LOG_PATH` so that it points to the logs (annotations), `METRIC_CACHE_PATH` so that it points to the metric-cache and `OUTPUT_DIR` so that it points to a directory where the evaluation csv will be stored** +**Note: You have to adapt the variables `LOG_PATH` so that it points to the [logs (annotations)](https://github.com/autonomousvision/navsim/blob/main/docs/install.md#1-download-the-demo-data), `METRIC_CACHE_PATH` so that it points to the [metric cache](https://github.com/autonomousvision/navsim/blob/main/docs/cache.md#understanding-the-data-format-and-classes) and `OUTPUT_DIR` so that it points to a directory where the evaluation csv will be stored** -By default, this will generate an evaluation csv for a simple constant velocity planning baseline. You can modify the script to evaluate your own planning agent. +By default, this will generate an evaluation csv for a simple constant velocity [planning baseline](https://github.com/autonomousvision/navsim/blob/main/docs/agents.md#output). You can modify the script to evaluate your own planning agent. For instance, you can add a new config for your agent under `$NAVSIM_DEVKIT_ROOT/navsim/navsim/planning/script/config/pdm_scoring/agent/my_new_agent.yaml`. Then, running your own agent is as simple as adding an override `agent=my_new_agent` to the script.