Skip to content

Commit

Permalink
docs(ansible): add sha256sum instruction for downloaded files
Browse files Browse the repository at this point in the history 
Signed-off-by: Alexey Panferov <[email protected]>
  • Loading branch information
@lexavtanke
lexavtanke committed Sep 25, 2023
1 parent 7ea3261 commit 73e60fb
Showing 1 changed file with 66 additions and 84 deletions.
150 changes: 66 additions & 84 deletions ansible/roles/artifacts/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,127 +6,73 @@ The Autoware perception stack uses models for inference. These models are automa

### Download instructions

The ONNX model files are stored in a common location, hosted by Web.Auto.
The ONNX model files are stored in a common location, hosted by Web.Auto

Any tool that can download files from the web (e.g. `wget` or `curl`) is the only requirement for downloading these files.

#### yabloc_pose_initializer

| file | checksum |
| ---------------- | ----------------------------------------------------------------------- |
| resources.tar.gz | sha256:1f660e15f95074bade32b1f80dbf618e9cee1f0b9f76d3f4671cb9be7f56eb3a |
Any tool that can download files from the web (e.g. `wget` or `curl`) is the only requirement for downloading these files:

```console
# yabloc_pose_initializer

$ mkdir -p ~/autoware_data/yabloc_pose_initializer/
$ wget -P ~/autoware_data/yabloc_pose_initializer/ \
https://s3.ap-northeast-2.wasabisys.com/pinto-model-zoo/136_road-segmentation-adas-0001/resources.tar.gz
```

#### image_projection_based_fusion

| file | checksum |
| ----------------------------------------- | ------------------------------------ |
| pts_voxel_encoder_pointpainting.onnx | md5:25c70f76a45a64944ccd19f604c99410 |
| pts_backbone_neck_head_pointpainting.onnx | md5:2c7108245240fbd7bf0104dd68225868 |
# image_projection_based_fusion

```console
$ mkdir -p ~/autoware_data/image_projection_based_fusion/
$ wget -P ~/autoware_data/image_projection_based_fusion/ \
https://awf.ml.dev.web.auto/perception/models/pointpainting/v4/pts_voxel_encoder_pointpainting.onnx \
https://awf.ml.dev.web.auto/perception/models/pointpainting/v4/pts_backbone_neck_head_pointpainting.onnx
```

#### lidar_apollo_instance_segmentation

| file | checksum |
| ---------------------- | ------------------------------------ |
| vlp-16.onnx checksum: | md5:63a5a1bb73f7dbb64cf70d04eca45fb4 |
| hdl-64.onnx checksum: | md5:009745e33b1df44b68296431cc384cd2 |
| vls-128.onnx checksum: | md5:b2d709f56f73ae2518c9bf4d0214468f |
# lidar_apollo_instance_segmentation

```console
$ mkdir -p ~/autoware_data/lidar_apollo_instance_segmentation/
$ wget -P ~/autoware_data/lidar_apollo_instance_segmentation/ \
https://awf.ml.dev.web.auto/perception/models/lidar_apollo_instance_segmentation/vlp-16.onnx \
https://awf.ml.dev.web.auto/perception/models/lidar_apollo_instance_segmentation/hdl-64.onnx \
https://awf.ml.dev.web.auto/perception/models/lidar_apollo_instance_segmentation/vls-128.onnx
```

#### lidar_centerpoint

| file | checksum |
| -------------------------------------------- | ----------------------------------------------------------------------- |
| pts_voxel_encoder_centerpoint.onnx | sha256:dc1a876580d86ee7a341d543f8ade2ede7f43bd032dc5b44155b1f0175405764 |
| pts_backbone_neck_head_centerpoint.onnx | sha256:3fe7e128955646740c41a25be0c8f141d5a94594fe79d7405fe2a859e391542e |
| pts_voxel_encoder_centerpoint_tiny.onnx | sha256:2c53465715c1fd2e9dc5727ef3fca74f4cdf0538f74286b0946e219d0ca5693b |
| pts_backbone_neck_head_centerpoint_tiny.onnx | md5:e4658325b70222f7c3637fe00e586b82 |
# lidar_centerpoint

```console
$ mkdir -p ~/autoware_data/lidar_centerpoint/
$ wget -P ~/autoware_data/lidar_centerpoint/ \
https://awf.ml.dev.web.auto/perception/models/centerpoint/v2/pts_voxel_encoder_centerpoint.onnx \
https://awf.ml.dev.web.auto/perception/models/centerpoint/v2/pts_backbone_neck_head_centerpoint.onnx \
https://awf.ml.dev.web.auto/perception/models/centerpoint/v2/pts_voxel_encoder_centerpoint_tiny.onnx \
https://awf.ml.dev.web.auto/perception/models/centerpoint/v2/pts_backbone_neck_head_centerpoint_tiny.onnx
```

#### tensorrt_yolo

| file | checksum |
| ---------------- | ----------------------------------------------------------------------- |
| yolov3.onnx | sha256:61e922f76918dd3d8e0abdc5fb7406f390609e08bd8ab9e5d3b97afb00f30f8c |
| yolov4.onnx | sha256:7c7343156c1bd4b397fd1e44b27334691a6219db3ce2e29a03b72af65ddb8f39 |
| yolov4-tiny.onnx | sha256:0e877c716fbf8a2b431ee3e57f6c7411a6741319b52c32c6dafc53c7e1b17027 |
| yolov5s.onnx | sha256:be335ff7746957debf1a6903a61fa3f568b780b4afe4958edf2d4bc98e9e0825 |
| yolov5m.onnx | sha256:ee6f67f7c00a34cc4cef2fdd9db30dd714df1a4fb2d7e9fc1731cfe85b673133 |
| yolov5l.onnx | sha256:a627e5f70180a8746482b572194090466db62c8d1256602c1cd20374dd960e34 |
| yolov5x.onnx | sha256:d7cb4cd7078f87bda22a37828d72867accecedf9f74d0d87b5cc1f6f1180a019 |
| coco.names | sha256:634a1132eb33f8091d60f2c346ababe8b905ae08387037aed883953b7329af84 |
# tensorrt_yolo

```console
$ mkdir -p ~/autoware_data/tensorrt_yolo/
$ wget -P ~/autoware_data/tensorrt_yolo/ \
https://awf.ml.dev.web.auto/perception/models/c \
https://awf.ml.dev.web.auto/perception/models/c \
https://awf.ml.dev.web.auto/perception/models/yolov3.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov4.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov4-tiny.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov5s.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov5m.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov5l.onnx \
https://awf.ml.dev.web.auto/perception/models/yolov5x.onnx \
https://awf.ml.dev.web.auto/perception/models/coco.names
```

#### tensorrt_yolox

| file | checksum |
| ------------------------------------------- | ----------------------------------------------------------------------- |
| yolox-tiny.onnx | sha256:471a665f4243e654dff62578394e508db22ee29fe65d9e389dfc3b0f2dee1255 |
| yolox-sPlus-opt.onnx | md5:bf3b0155351f90fcdca2626acbfd3bcf |
| yolox-sPlus-opt.EntropyV2-calibration.table | md5:c6e6f1999d5724a017516a956096701f |
| label.txt | sha256:3540a365bfd6d8afb1b5d8df4ec47f82cb984760d3270c9b41dbbb3422d09a0c |
# tensorrt_yolox

```console
$ mkdir -p ~/autoware_data/tensorrt_yolox/
$ wget -P ~/autoware_data/tensorrt_yolox/ \
https://awf.ml.dev.web.auto/perception/models/yolox-tiny.onnx \
https://awf.ml.dev.web.auto/perception/models/yolox-sPlus-opt.onnx \
https://awf.ml.dev.web.auto/perception/models/yolox-sPlus-opt.EntropyV2-calibration.table \
https://awf.ml.dev.web.auto/perception/models/object_detection_yolox_s/v1/yolox-sPlus-T4-960x960-pseudo-finetune.onnx \
https://awf.ml.dev.web.auto/perception/models/object_detection_yolox_s/v1/yolox-sPlus-T4-960x960-pseudo-finetune.EntropyV2-calibration.table \
https://awf.ml.dev.web.auto/perception/models/label.txt
```

#### traffic_light_classifier

| file | checksum |
| ----------------------------------------------------- | ----------------------------------------------------------------------- |
| traffic_light_classifier_mobilenetv2_batch_1.onnx | md5:caa51f2080aa2df943e4f884c41898eb |
| traffic_light_classifier_mobilenetv2_batch_4.onnx | md5:c2beaf60210f471debfe72b86d076ca0 |
| traffic_light_classifier_mobilenetv2_batch_6.onnx | md5:28b408710bcb24f4cdd4d746301d4e78 |
| traffic_light_classifier_efficientNet_b1_batch_1.onnx | md5:82baba4fcf1abe0c040cd55005e34510 |
| traffic_light_classifier_efficientNet_b1_batch_4.onnx | md5:21b549c2fe4fbb20d32cc019e6d70cd7 |
| traffic_light_classifier_efficientNet_b1_batch_6.onnx | md5:378526d9aa9fc6705cf399f7b35b3053 |
| lamp_labels.txt | sha256:1a5a49eeec5593963eab8d70f48b8a01bfb07e753e9688eb1510ad26e803579d |
# traffic_light_classifier

```console
$ mkdir -p ~/autoware_data/traffic_light_classifier/
$ wget -P ~/autoware_data/traffic_light_classifier/ \
https://awf.ml.dev.web.auto/perception/models/traffic_light_classifier/v2/traffic_light_classifier_mobilenetv2_batch_1.onnx \
Expand All @@ -136,36 +82,72 @@ $ wget -P ~/autoware_data/traffic_light_classifier/ \
https://awf.ml.dev.web.auto/perception/models/traffic_light_classifier/v2/traffic_light_classifier_efficientNet_b1_batch_4.onnx \
https://awf.ml.dev.web.auto/perception/models/traffic_light_classifier/v2/traffic_light_classifier_efficientNet_b1_batch_6.onnx \
https://awf.ml.dev.web.auto/perception/models/traffic_light_classifier/v2/lamp_labels.txt
```

#### traffic_light_fine_detector

| file | checksum |
| ------------------------ | ------------------------------------ |
| tlr_yolox_s_batch_1.onnx | md5:2b72d085022b8ee6aacff06bd722cfda |
| tlr_yolox_s_batch_4.onnx | md5:4044daa86e7776ce241e94d98a09cc0e |
| tlr_yolox_s_batch_6.onnx | md5:47255a11bde479320d703f1f45db1242 |
| tlr_labels.txt | md5:e9f45efb02f2a9aa8ac27b3d5c164905 |
# traffic_light_fine_detector

```console
$ mkdir -p ~/autoware_data/traffic_light_fine_detector/
$ wget -P ~/autoware_data/traffic_light_fine_detector/ \
https://awf.ml.dev.web.auto/perception/models/tlr_yolox_s/v2/tlr_yolox_s_batch_1.onnx \
https://awf.ml.dev.web.auto/perception/models/tlr_yolox_s/v2/tlr_yolox_s_batch_4.onnx \
https://awf.ml.dev.web.auto/perception/models/tlr_yolox_s/v2/tlr_yolox_s_batch_6.onnx \
https://awf.ml.dev.web.auto/perception/models/tlr_yolox_s/v2/tlr_labels.txt
```

#### traffic_light_ssd_fine_detector

| file | checksum |
| --------------------- | ----------------------------------------------------------------------- |
| mb2-ssd-lite-tlr.onnx | sha256:e29e6ee68751a270fb285fd037713939ca7f61a897b4c3a7ab22b0d6a9a21ddf |
| voc_labels_tl.txt | sha256:a41e6e3324e32c30b3b2fe38908eaf3471e2bfdaeb9e14ca0c1c3bc0275119c6 |
# traffic_light_ssd_fine_detector

```console
$ mkdir -p ~/autoware_data/traffic_light_ssd_fine_detector/
$ wget -P ~/autoware_data/traffic_light_ssd_fine_detector/ \
https://awf.ml.dev.web.auto/perception/models/mb2-ssd-lite-tlr.onnx \
https://awf.ml.dev.web.auto/perception/models/voc_labels_tl.txt
```

After downloading you can check intergity of the files with ```sha256sum```.

Check warning on line 105 in ansible/roles/artifacts/README.md

View workflow job for this annotation

GitHub Actions / spell-check-differential 

Unknown word (intergity)

You need to put ```SHA256SUMS``` file listed below in to autoware_data directory:

```console
7fe62fcebe0e0f62a000d06aa94d779feb444d933671a4a3189fe01be8c19a00 ./image_projection_based_fusion/pts_backbone_neck_head_pointpainting.onnx
3ca452ea5ca9467bf782955f75704ba8466841e275e8b8acd991b9911d53249e ./image_projection_based_fusion/pts_voxel_encoder_pointpainting.onnx
86348d8c4bced750f54288b01cc471c0d4f1ec9c693466169ef19413731e6ecc ./lidar_apollo_instance_segmentation/hdl-64.onnx
eec521ebad7553d0ea2c90472a293aecb7499ab592632f0e100481c8196eb421 ./lidar_apollo_instance_segmentation/vlp-16.onnx
95ef950bb694bd6de91b7e47f5d191d557e92a7f5e2a6bdf655a8b5eed4075cc ./lidar_apollo_instance_segmentation/vls-128.onnx
3fe7e128955646740c41a25be0c8f141d5a94594fe79d7405fe2a859e391542e ./lidar_centerpoint/pts_backbone_neck_head_centerpoint.onnx
9bb0b634f3664bd098ce7d6a3d8a9fb7cc8d9b8252b27f302c71e43316bab551 ./lidar_centerpoint/pts_backbone_neck_head_centerpoint_tiny.onnx
dc1a876580d86ee7a341d543f8ade2ede7f43bd032dc5b44155b1f0175405764 ./lidar_centerpoint/pts_voxel_encoder_centerpoint.onnx
2c53465715c1fd2e9dc5727ef3fca74f4cdf0538f74286b0946e219d0ca5693b ./lidar_centerpoint/pts_voxel_encoder_centerpoint_tiny.onnx
634a1132eb33f8091d60f2c346ababe8b905ae08387037aed883953b7329af84 ./tensorrt_yolo/coco.names
61e922f76918dd3d8e0abdc5fb7406f390609e08bd8ab9e5d3b97afb00f30f8c ./tensorrt_yolo/yolov3.onnx
0e877c716fbf8a2b431ee3e57f6c7411a6741319b52c32c6dafc53c7e1b17027 ./tensorrt_yolo/yolov4-tiny.onnx
7c7343156c1bd4b397fd1e44b27334691a6219db3ce2e29a03b72af65ddb8f39 ./tensorrt_yolo/yolov4.onnx
a627e5f70180a8746482b572194090466db62c8d1256602c1cd20374dd960e34 ./tensorrt_yolo/yolov5l.onnx
ee6f67f7c00a34cc4cef2fdd9db30dd714df1a4fb2d7e9fc1731cfe85b673133 ./tensorrt_yolo/yolov5m.onnx
be335ff7746957debf1a6903a61fa3f568b780b4afe4958edf2d4bc98e9e0825 ./tensorrt_yolo/yolov5s.onnx
d7cb4cd7078f87bda22a37828d72867accecedf9f74d0d87b5cc1f6f1180a019 ./tensorrt_yolo/yolov5x.onnx
3540a365bfd6d8afb1b5d8df4ec47f82cb984760d3270c9b41dbbb3422d09a0c ./tensorrt_yolox/label.txt
cc378d327db5616b0b3a4d077bf37100c25a50ecd22d2b542f54098da100f34c ./tensorrt_yolox/yolox-sPlus-T4-960x960-pseudo-finetune.EntropyV2-calibration.table
f5054e8a890c3be86dc1b4b89a5a36fb2279d4f6110b0159e793be062641bf65 ./tensorrt_yolox/yolox-sPlus-T4-960x960-pseudo-finetune.onnx
b9e9d7da33342262ccaea4469b4d02b8abb32b6d7bf737f9e0883fece1b8f580 ./tensorrt_yolox/yolox-sPlus-opt.EntropyV2-calibration.table
36b0832177b01e6b278e00c7369f1de71e616c36261cbae50f0753d41289da01 ./tensorrt_yolox/yolox-sPlus-opt.onnx
471a665f4243e654dff62578394e508db22ee29fe65d9e389dfc3b0f2dee1255 ./tensorrt_yolox/yolox-tiny.onnx
1a5a49eeec5593963eab8d70f48b8a01bfb07e753e9688eb1510ad26e803579d ./traffic_light_classifier/lamp_labels.txt
55ebb0d117a5e8943f8d1c6769f1d856b533079d4d871d8e923255cc992ad48a ./traffic_light_classifier/traffic_light_classifier_efficientNet_b1_batch_1.onnx
684e29843e3128eadb774018730644b3ab9b0a06dc4cdaeed579c2f3fa5d5265 ./traffic_light_classifier/traffic_light_classifier_efficientNet_b1_batch_4.onnx
44d94540fa8b89dfb39cd9a8523cf010ddfb10ea2f1f9b53bf3618ce7f4912ad ./traffic_light_classifier/traffic_light_classifier_efficientNet_b1_batch_6.onnx
455b71b3b20d3a96aa0e49f32714ba50421f668a2f9b9907c30b1346ac8a3703 ./traffic_light_classifier/traffic_light_classifier_mobilenetv2_batch_1.onnx
41bb79a23a4ac57956adb8e9cb3904420db1b0cd032e97b670cc4f8b174ae3fe ./traffic_light_classifier/traffic_light_classifier_mobilenetv2_batch_4.onnx
e4792eed6a46fdbd02be2f3a4f1ce91f36fa77698493caf3102e445178c0f058 ./traffic_light_classifier/traffic_light_classifier_mobilenetv2_batch_6.onnx
a41e6e3324e32c30b3b2fe38908eaf3471e2bfdaeb9e14ca0c1c3bc0275119c6 ./traffic_light_fine_detector/tlr_labels.txt
922839fcf22bd32ae5065146fcec193e9d6360ca03bd4c83faea835045daf8eb ./traffic_light_fine_detector/tlr_yolox_s_batch_1.onnx
b3c6e00acc6ff547d165469684ffb620a9a6330e9d591d445f50c4cf5cb4e292 ./traffic_light_fine_detector/tlr_yolox_s_batch_4.onnx
2824d4c5b7ab5f6bfd41e43e82747107c53e1c727b1cf1dd6746bc49e6749128 ./traffic_light_fine_detector/tlr_yolox_s_batch_6.onnx
e29e6ee68751a270fb285fd037713939ca7f61a897b4c3a7ab22b0d6a9a21ddf ./traffic_light_ssd_fine_detector/mb2-ssd-lite-tlr.onnx
a41e6e3324e32c30b3b2fe38908eaf3471e2bfdaeb9e14ca0c1c3bc0275119c6 ./traffic_light_ssd_fine_detector/voc_labels_tl.txt
1f660e15f95074bade32b1f80dbf618e9cee1f0b9f76d3f4671cb9be7f56eb3a ./yabloc_pose_initializer/resources.tar.gz
```

And run the command:

```console
sha256sum -c SHA256SUMS 2>&1
```

0 comments on commit 73e60fb

Please sign in to comment.