Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add tracking regression converter #44

Merged
merged 6 commits into from
Nov 15, 2023
Merged

Conversation

miursh
Copy link
Collaborator

@miursh miursh commented Nov 13, 2023

Description

Add tracking sim to tracking eval converter.

How to review

Make sure that the following conversion works properly.

How to test

test data

test command

For tracking debugger rosbag

python -m perception_dataset.convert --config config/rosbag2_to_t4/convert_tracking_debugger_to_tracking_eval.yaml

For scenario simulator rosbag

python -m perception_dataset.convert --config config/rosbag2_to_t4/convert_scenario_sim_to_tracking_eval.yaml

Reference

Notes for reviewer

@miursh miursh requested a review from YoshiRi November 13, 2023 17:54
miursh and others added 3 commits November 14, 2023 03:06
Signed-off-by: Shunsuke Miura <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Copy link

@YoshiRi YoshiRi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Worked with my test rosbag!
LGTM

@miursh miursh enabled auto-merge (squash) November 15, 2023 06:24
@miursh miursh merged commit c24b5ae into main Nov 15, 2023
5 checks passed
@miursh miursh deleted the feat/tracking_regression_test branch November 15, 2023 06:33
KSeangTan pushed a commit that referenced this pull request Jan 16, 2025
feat: publish as oss

build(deps): bump pillow from 8.4.0 to 9.3.0 (#1)

Bumps [pillow](https://github.com/python-pillow/Pillow) from 8.4.0 to 9.3.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/8.4.0...9.3.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

fix: t4 format 3d detailed (#2)

* docs: replace our with the

* fix: layout

* fix: layout

feat: add sample dataset link (#3)

* add sample dataset link

Signed-off-by: Shunsuke Miura <[email protected]>

* fix typo

Signed-off-by: Shunsuke Miura <[email protected]>

* Change wording

Signed-off-by: Shunsuke Miura <[email protected]>

* formatting

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

docs: add rosbag2 pre process (#4)

* fix: delete unused link

* docs: add rosbag pre-process

* Update docs/tools_overview.md

Co-authored-by: Shunsuke Miura <[email protected]>

* fix: pre-process command

* fix: markdown lint

---------

Co-authored-by: Shunsuke Miura <[email protected]>

docs: update t4 format category name (#6)

* docs: update t4 format category name

Signed-off-by: Shunsuke Miura <[email protected]>

* fix format

Signed-off-by: Shunsuke Miura <[email protected]>

* change to lowercase

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

docs: add deepen annotation (#5)

* docs: add deepen annotation

* docs: use overwirte option

* docs: refer to category.json

feat(label_converter): add support of loading labels and attributes map from yaml files (#7)

* feat: add support of loading labels and attributes map from yaml files

Signed-off-by: ktro2828 <[email protected]>

* chore: pre-commit

Signed-off-by: ktro2828 <[email protected]>

* feat: update labels

Signed-off-by: ktro2828 <[email protected]>

* fix label definition

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

fix: instruction about pseudo-labeling (#9)

* fix: instruction about pseudo-labeling

Signed-off-by: Shunsuke Miura <[email protected]>

* add description

Signed-off-by: Shunsuke Miura <[email protected]>

* update the documet

Signed-off-by: Shunsuke Miura <[email protected]>

* formatting

Signed-off-by: Shunsuke Miura <[email protected]>

* Update docs/tools_overview.md

Co-authored-by: Hayato Mizushima <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: Hayato Mizushima <[email protected]>

feat: add test for t4 dataset conversion (#10)

* fix: validator is_valid check

Signed-off-by: Shunsuke Miura <[email protected]>

* update document

Signed-off-by: Shunsuke Miura <[email protected]>

* feat: sync from original AWML dataset

Signed-off-by: Shunsuke Miura <[email protected]>

* fix deepen to t4 config yaml

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug in deepen to t4

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pedestrian attribute

Signed-off-by: Shunsuke Miura <[email protected]>

* change three_d_box to three_d_bbox

Signed-off-by: Shunsuke Miura <[email protected]>

* feat: add test for t4 dataset converter

Signed-off-by: Shunsuke Miura <[email protected]>

* apply flake8

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pytest

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pytest again

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat: add scene description (#12)

* feat: add scene description

Signed-off-by: Shunsuke Miura <[email protected]>

* update to use description written in config

Signed-off-by: Shunsuke Miura <[email protected]>

* update description writing

Signed-off-by: Shunsuke Miura <[email protected]>

* change config param, update test

Signed-off-by: Shunsuke Miura <[email protected]>

* formatting

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

chore(release): v1.0.1 (#13)

Signed-off-by: Shunsuke Miura <[email protected]>

feat: add support of `__str__` method in `LABEL_PATH_ENUM` (#14)

Signed-off-by: ktro2828 <[email protected]>

feat: support non key frame conversion (#16)

* feat: support non key frame conversion

Signed-off-by: Shunsuke Miura <[email protected]>

* fix

Signed-off-by: Shunsuke Miura <[email protected]>

* add invalid 2d box check

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat!: update to format v1.1 (#11)

* feat: add support of converting RadarTracks into json

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of velocity and acceleration for sample_annotation

Signed-off-by: ktro2828 <[email protected]>

* feat: update velocity and acceleration

Signed-off-by: ktro2828 <[email protected]>

* feat: update default radar topics

Signed-off-by: ktro2828 <[email protected]>

* fix: update to allow radar modality

Signed-off-by: ktro2828 <[email protected]>

* tmp: update

Signed-off-by: ktro2828 <[email protected]>

* feat: add test for t4 dataset conversion (#10)

* fix: validator is_valid check

Signed-off-by: Shunsuke Miura <[email protected]>

* update document

Signed-off-by: Shunsuke Miura <[email protected]>

* feat: sync from original AWML dataset

Signed-off-by: Shunsuke Miura <[email protected]>

* fix deepen to t4 config yaml

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug in deepen to t4

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pedestrian attribute

Signed-off-by: Shunsuke Miura <[email protected]>

* change three_d_box to three_d_bbox

Signed-off-by: Shunsuke Miura <[email protected]>

* feat: add test for t4 dataset converter

Signed-off-by: Shunsuke Miura <[email protected]>

* apply flake8

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pytest

Signed-off-by: Shunsuke Miura <[email protected]>

* fix pytest again

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

* feat: add support of velocity and acceleration for sample_annotation

Signed-off-by: ktro2828 <[email protected]>

* feat: update

Signed-off-by: ktro2828 <[email protected]>

* add radar config sample

Signed-off-by: Shunsuke Miura <[email protected]>

* chore: add radar sensors to radar config sample

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

feat: add ignore LiDAR drop option (#19)

* feat: add ignore LiDAR drop option

Signed-off-by: Shunsuke Miura <[email protected]>

* fix format

Signed-off-by: Shunsuke Miura <[email protected]>

* update bag starttime calc logic

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

docs(readme): install radar-msgs (#23)

feat: remove old autoware perception msgs (#26)

* test: update tests for new synthetic data format

Signed-off-by: yukke42 <[email protected]>

* Delete DynamicObjectArray related codes

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: yukke42 <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

feat: update TLR dataset conversion (#25)

* update TLR-related dataset conversion

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add filename zero-fill

Signed-off-by: Shunsuke Miura <[email protected]>

* update image generation logic

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug

Signed-off-by: Shunsuke Miura <[email protected]>

* change output message

Signed-off-by: Shunsuke Miura <[email protected]>

* update sensor index handling

Signed-off-by: Shunsuke Miura <[email protected]>

* add tier4_perception_msgs to build target

Signed-off-by: Shunsuke Miura <[email protected]>

* update dependancy

Signed-off-by: Shunsuke Miura <[email protected]>

* add TLR conversion test

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix sensor_id bug

Signed-off-by: Shunsuke Miura <[email protected]>

* change filename to 5-digit

Signed-off-by: Shunsuke Miura <[email protected]>

* add none check before use

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

chore(release): v1.0.2 (#27)

Signed-off-by: Shunsuke Miura <[email protected]>

docs(readme): install radar-msgs (#29)

Co-authored-by: Yusuke Muramatsu <[email protected]>

docs: update of setup instructions (#33)

feat(deepen_to_t4): add annotation data index check (#32)

Signed-off-by: Shunsuke Miura <[email protected]>

feat: update synthetic data mapping (#28)

* feat: update mapping

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: use motorcycle instead of motorbike

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Yusuke Muramatsu <[email protected]>

[pre-commit.ci] pre-commit autoupdate (#41)

updates:
- [github.com/pre-commit/pre-commit-hooks: v4.4.0 → v4.5.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.4.0...v4.5.0)
- [github.com/igorshubovych/markdownlint-cli: v0.33.0 → v0.37.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.33.0...v0.37.0)
- [github.com/pre-commit/mirrors-prettier: v3.0.0-alpha.4 → v3.0.3](https://github.com/pre-commit/mirrors-prettier/compare/v3.0.0-alpha.4...v3.0.3)
- [github.com/gruntwork-io/pre-commit: v0.1.18 → v0.1.22](https://github.com/gruntwork-io/pre-commit/compare/v0.1.18...v0.1.22)
- [github.com/psf/black: 23.1.0 → 23.10.1](https://github.com/psf/black/compare/23.1.0...23.10.1)
- [github.com/PyCQA/flake8: 6.0.0 → 6.1.0](https://github.com/PyCQA/flake8/compare/6.0.0...6.1.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat: camera images and 2d annotations generation (#24)

* enable synthetic camera images decoding

* fixed camera view orientation for synthetic data

* increased _TIMESTAMP_DIFF to be able to generate syntetic data - workaround for Unity's step execution issue

* implemented generation of 2d bounding boxes annotations in object_ann.json file

* updated tools overview.md

* added script argument --generate-bbox-from-cuboid to generate 2d bboxes from cuboids

* Added log when --generate-bbox-from-cuboid is true but no cameras are provided

* feat: parametrize timestamp_diff

add 2d attribute merger (#42)

Signed-off-by: Shunsuke Miura <[email protected]>

feat: add tracking regression converter (#44)

* add tracking regression converter

Signed-off-by: Shunsuke Miura <[email protected]>

* fix comment

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

chore: update poetry (#47)

* remove open3d

Signed-off-by: Shunsuke Miura <[email protected]>

* add pyparsing

Signed-off-by: Shunsuke Miura <[email protected]>

* add matplotlib

Signed-off-by: Shunsuke Miura <[email protected]>

* add pandas

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

chore(release): v1.0.3 (#45)

Signed-off-by: Shunsuke Miura <[email protected]>

fix(rosbag2_to_non_annotated_t4): frame number calc (#50)

* fix frame number calc

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: Shunsuke Miura <[email protected]>

* update the tests in accordance with the code changes

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

docs: update gnss topics for input_bag (#52)

Signed-off-by: Shin-kyoto <[email protected]>

fix(deepen_to_t4): handling non keyframe in sample (#38)

* add key_frame fixing script

Signed-off-by: Shunsuke Miura <[email protected]>

* remove debug code

Signed-off-by: Shunsuke Miura <[email protected]>

* refactor

Signed-off-by: Shunsuke Miura <[email protected]>

* add sample and sample_annotation cleanup

* rename class

Signed-off-by: Shunsuke Miura <[email protected]>

* apply resolve to deepne_to_t4

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug

Signed-off-by: Shunsuke Miura <[email protected]>

* change to use .get() for "is_valid"

Signed-off-by: Shunsuke Miura <[email protected]>

* add list length check to avoid error

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* change _remove_sample_of_non_keyframe to support 2d only annotation

Signed-off-by: Shunsuke Miura <[email protected]>

* modify to exclude instances that only have 2D annotations

Signed-off-by: Shunsuke Miura <[email protected]>

* fix finding next closest keyframe logic

Signed-off-by: Shunsuke Miura <[email protected]>

* set message display interval and limit print statements

Signed-off-by: Shunsuke Miura <[email protected]>

* update test_t4_dataset_conversion with todo comments

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat: ensure /tf and /tf_static topics are present, and adjust frame timestamp comparison (#54)

* raise an error when tf does not exit

Signed-off-by: Shunsuke Miura <[email protected]>

* chore: adjust frame timestamp comparison in _Rosbag2ToNonAnnotatedT4Converter

Signed-off-by: Shunsuke Miura <[email protected]>

* fix error message

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

refactor(rosbag2_to_non_annotated_t4_converter): refactor _convert_image for test (#55)

* feat: finalize refactoring, now testing

Signed-off-by: kminoda <[email protected]>

* feat: add test

Signed-off-by: kminoda <[email protected]>

* apply pre-commit

Signed-off-by: kminoda <[email protected]>

* fix bugs

Signed-off-by: kminoda <[email protected]>

* minor fix in type hint

Signed-off-by: kminoda <[email protected]>

* feat: add more tests

Signed-off-by: kminoda <[email protected]>

* import pytest

Signed-off-by: kminoda <[email protected]>

* remove two frame_index variables

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add msg display interval

Signed-off-by: kminoda <[email protected]>

* remove end_timestamp

Signed-off-by: kminoda <[email protected]>

* fix: fix camera-only mode

Signed-off-by: kminoda <[email protected]>

* fix bug

Signed-off-by: kminoda <[email protected]>

* revert change

Signed-off-by: kminoda <[email protected]>

* fix: fix a bug in handling dropped image

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: add is_key_frame arg in dummy image generation

Signed-off-by: kminoda <[email protected]>

* fix: fix test

Signed-off-by: kminoda <[email protected]>

* fix: remove duplicated line

Signed-off-by: kminoda <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(convert): add annotated_t4_to_deepen (#57)

* feat(convert): add annotated_t4_to_deepen

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: update default config

Signed-off-by: kminoda <[email protected]>

* fix: update default config

Signed-off-by: kminoda <[email protected]>

* feat: update readme

Signed-off-by: kminoda <[email protected]>

* fix: rename t4 to non_annotated_t4

Signed-off-by: kminoda <[email protected]>

* fix: fix docs

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: change default label_only value

Signed-off-by: kminoda <[email protected]>

* Update docs/tools_overview.md

Co-authored-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

fix(rosbag_to_non_annotated_t4): fix non initialized variable (#59)

Signed-off-by: kminoda <[email protected]>

fix(deepen_to_t4): change nbr_samples in keyframe_consistency_resolver and add timestamp assertions in test (#60)

* fix: change nbr_samples in keyframe_consistency_resolver

Signed-off-by: Shunsuke Miura <[email protected]>

* test: Add timestamp assertions for ego_pose and sample_data

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat: add tracking sim converter test (#63)

* feat:add tracking sim converter test

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add document

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix(annotated_t4_to_deepen): fix file_id output (#64)

* fix(annotated_t4_to_deepen): fix file_id output

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

feat: port rosbag2_to_annotated_t4_tlr (#62)

* feat: move rosbag2_to_annotated_t4_tlr.py

Signed-off-by: kminoda <[email protected]>

* feat: port basic yaml files

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: port Annotated T4 TLR to deepen converter

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* docs: port markdown

Signed-off-by: kminoda <[email protected]>

* revert: revert unnecessary added file

Signed-off-by: kminoda <[email protected]>

* fix: delete unintended file

Signed-off-by: kminoda <[email protected]>

* fix config file name

Signed-off-by: kminoda <[email protected]>

* fix: fix some minor bugs EXCEPT missing self._end_timestamp

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: fix import

Signed-off-by: kminoda <[email protected]>

* feat: update yaml file

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tests/config

Signed-off-by: Shunsuke Miura <[email protected]>

* update the specification of mandatory topics

---------

Signed-off-by: kminoda <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

chore(release): v1.0.4 (#66)

* increment version number

Signed-off-by: Shunsuke Miura <[email protected]>

* update poetry

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat(rosbag_to_non_annotated_t4): support lidar drop (#58)

* feat: add lidar point filtering (still not working for image fusion part)

Signed-off-by: kminoda <[email protected]>

* feat(rosbag_to_non_annotated_t4): support lidar drop

Signed-off-by: kminoda <[email protected]>

* feat: update test

Signed-off-by: kminoda <[email protected]>

* feat: apply pre-commit

Signed-off-by: kminoda <[email protected]>

* feat: add test

Signed-off-by: kminoda <[email protected]>

* fix: fix comment

Signed-off-by: kminoda <[email protected]>

* fix: reorganize arguments for latency handling

Signed-off-by: kminoda <[email protected]>

* test: add test

Signed-off-by: kminoda <[email protected]>

* fix: fix for executable script

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: add document for get_lidar_camera_synced_frame_info

Signed-off-by: kminoda <[email protected]>

* feat: update args to lidar_to_camera_latency_sec

Signed-off-by: kminoda <[email protected]>

* feat: add lidar_latency

Signed-off-by: kminoda <[email protected]>

* feat: add lidar-camera latency margin

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: add comment

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: parametrize self._lidar_points_ratio_threshold

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: remove image drop error and fix docs

Signed-off-by: kminoda <[email protected]>

* test: remove unnecessary test

Signed-off-by: kminoda <[email protected]>

* fix pre-commit

Signed-off-by: kminoda <[email protected]>

* remove magic number

Signed-off-by: kminoda <[email protected]>

* feat: extend range

Signed-off-by: kminoda <[email protected]>

* fix: remove params.timestamp_diff

Signed-off-by: kminoda <[email protected]>

* fix: change default param of ratio_points

Signed-off-by: kminoda <[email protected]>

* revert: revert unnecessary change

Signed-off-by: kminoda <[email protected]>

* feat: change logic so that the experiment in the description is valid

Signed-off-by: kminoda <[email protected]>

* feat: remove accept_frame_drop from _convert_image()

Signed-off-by: kminoda <[email protected]>

* fix: remove unnecessary comment

Signed-off-by: kminoda <[email protected]>

* feat: improve rosbag2_utils.pointcloud_msg_to_numpy

Signed-off-by: kminoda <[email protected]>

* feat: use lower case for timestamp_diff

Signed-off-by: kminoda <[email protected]>

* feat: replace matching algorithm with prior knowledge about camera latency

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert: revert unnecessary added file

Signed-off-by: kminoda <[email protected]>

* fix: fix default vale

Signed-off-by: kminoda <[email protected]>

* fix: fix test config

Signed-off-by: kminoda <[email protected]>

* fix: update config

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update config

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* modify a config for synthetic dataset

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

increment version (#68)

Signed-off-by: Shunsuke Miura <[email protected]>

feat(annotated_to_deepen): add default attributes (#67)

* feat(annotated_to_deepen): add default attributes

Signed-off-by: kminoda <[email protected]>

* fix: fix variable name

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* test: remove attribute test from tracking sim test

Signed-off-by: kminoda <[email protected]>

* test: fix attribute length

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

chore(deepent_to_t4): fix type hints of input_bag_base (#72)

Signed-off-by: yukke42 <[email protected]>

feat: add data interpolation (#51)

* feat: add support of interpolating data with specified Hz

Signed-off-by: ktro2828 <[email protected]>

* chore: add script to debug with plot

Signed-off-by: ktro2828 <[email protected]>

* feat: update

Signed-off-by: ktro2828 <[email protected]>

* feat: update with multiprocessing

Signed-off-by: ktro2828 <[email protected]>

* fix: interpolation step

Signed-off-by: ktro2828 <[email protected]>

* fix: update to skip interpolation if interpolated there is no timestamp for ego pose

Signed-off-by: ktro2828 <[email protected]>

* fix: update to avoid error

Signed-off-by: ktro2828 <[email protected]>

* fix: avoid error in case of the number of interepolated timestamps are less than 2

Signed-off-by: ktro2828 <[email protected]>

* feat: remove to interpolate `sample_data.json`

Signed-off-by: ktro2828 <[email protected]>

* fix: fix bug that wrong next token is inserted

Signed-off-by: ktro2828 <[email protected]>

* docs: add tasks directory and document for interpolation

Signed-off-by: ktro2828 <[email protected]>

* feat: update interpolation based on LiDAR sample data

Signed-off-by: ktro2828 <[email protected]>

* docs: update the document

Signed-off-by: ktro2828 <[email protected]>

* refactor: update plots

Signed-off-by: ktro2828 <[email protected]>

* Update perception_dataset/t4_dataset/data_interpolator.py

Co-authored-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

build(deps): bump pillow from 9.5.0 to 10.2.0 (#75)

Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.5.0 to 10.2.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/9.5.0...10.2.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

[pre-commit.ci] pre-commit autoupdate (#74)

updates:
- [github.com/igorshubovych/markdownlint-cli: v0.37.0 → v0.38.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.37.0...v0.38.0)
- [github.com/pre-commit/mirrors-prettier: v3.0.3 → v4.0.0-alpha.8](https://github.com/pre-commit/mirrors-prettier/compare/v3.0.3...v4.0.0-alpha.8)
- [github.com/gruntwork-io/pre-commit: v0.1.22 → v0.1.23](https://github.com/gruntwork-io/pre-commit/compare/v0.1.22...v0.1.23)
- [github.com/pycqa/isort: 5.12.0 → 5.13.2](https://github.com/pycqa/isort/compare/5.12.0...5.13.2)
- [github.com/psf/black: 23.10.1 → 23.12.1](https://github.com/psf/black/compare/23.10.1...23.12.1)
- [github.com/PyCQA/flake8: 6.1.0 → 7.0.0](https://github.com/PyCQA/flake8/compare/6.1.0...7.0.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

[pre-commit.ci] pre-commit autoupdate (#76)

* [pre-commit.ci] pre-commit autoupdate

updates:
- [github.com/igorshubovych/markdownlint-cli: v0.38.0 → v0.39.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.38.0...v0.39.0)
- [github.com/psf/black: 23.12.1 → 24.1.1](https://github.com/psf/black/compare/23.12.1...24.1.1)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix: update `TrafficSignal` to `TrafficLight` (#80)

* fix: update `TrafficSignal` to `TrafficLight`

Signed-off-by: ktro2828 <[email protected]>

* refactor: rename variables for `TrafficLightArray`

Signed-off-by: ktro2828 <[email protected]>

* refactor: revert the name back to `TrafficLightSignalArray` in docstring

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

feat(utils/misc): add guard for image_timestamp_list array (#78)

* feat(utils/misc): add guard for image_timestamp_list array

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

fix: adjust bbox mask based on frame and sensor (#79)

Co-authored-by: Kotaro Uetake <[email protected]>

fix(rosbag2_to_annotated_t4_tlr): make Rosbag2ToAnnotatedT4TlrConverter work (#82)

* fix Rosbag2ToAnnotatedT4TlrConverter to work well

Signed-off-by: Shunsuke Miura <[email protected]>

* add test

Signed-off-by: Shunsuke Miura <[email protected]>

* update test

Signed-off-by: Shunsuke Miura <[email protected]>

* pre-commit

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unnecessary files

Signed-off-by: Shunsuke Miura <[email protected]>

* Update perception_dataset/rosbag2/autoware_msgs.py

Co-authored-by: Kotaro Uetake <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kotaro Uetake <[email protected]>

chore(release): v1.0.6 (#83)

Signed-off-by: Shunsuke Miura <[email protected]>

feat: better typing (#85)

* feat: adjusted typing

* fix: wrong type used in isinstance

fix(rosbag2_t4_tlr): fix default delay_msec value (#84)

* fix(convert_rosbag2_to_non_annotated_t4_tlr): fix default delay_msec value

Signed-off-by: kminoda <[email protected]>

* update other delay_msec

Signed-off-by: kminoda <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>

ci: add workflow timeout (#89)

* ci: add workflow timeout

Signed-off-by: ktro2828 <[email protected]>

* ci: add timeout for build-and-test

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

fix: typo (#91)

feat(attribute_merger): merge turn signal/brake lamp annotation (#92)

* Add support for merging multiple JSON files in attribute merger feature

Signed-off-by: Shunsuke Miura <[email protected]>

* feat(attribute_merger): Exclude turn signals and brake lamps for pedestrians and bicycles

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unnecessary comments

Signed-off-by: Shunsuke Miura <[email protected]>

* fix category name

Signed-off-by: Shunsuke Miura <[email protected]>

* fix: add the matching threshold

Signed-off-by: Shunsuke Miura <[email protected]>

* Update config/add_2d_attribute.yaml

Co-authored-by: kminoda <[email protected]>

* Update perception_dataset/t4_dataset/attribute_merger.py

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: kminoda <[email protected]>

[pre-commit.ci] pre-commit autoupdate (#94)

updates:
- [github.com/pre-commit/pre-commit-hooks: v4.5.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.5.0...v4.6.0)
- [github.com/psf/black: 24.1.1 → 24.4.2](https://github.com/psf/black/compare/24.1.1...24.4.2)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix: modify key name and add option to exclude copying (#95)

* fix: prev key

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of excludes with `rsync`

Signed-off-by: ktro2828 <[email protected]>

* Update perception_dataset/t4_dataset/data_interpolator.py

Co-authored-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>
Co-authored-by: Shunsuke Miura <[email protected]>

feat: add fastlabel-2D to t4dataset converter (#93)

* feat: add fastlabel-2D to t4dataset converter

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* feat: overwrite instance token if already provided

Signed-off-by: Shunsuke Miura <[email protected]>

* apply pre-commit

Signed-off-by: Shunsuke Miura <[email protected]>

* Update the document

Signed-off-by: Shunsuke Miura <[email protected]>

* Cosmetic change in the document

Signed-off-by: Shunsuke Miura <[email protected]>

* bug fix

Signed-off-by: Shunsuke Miura <[email protected]>

* add visibility

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kotaro Uetake <[email protected]>

feat: bump version to v1.0.7 (#99)

Signed-off-by: kminoda <[email protected]>

feat: merge T4 Datasets with 2D Camera annotations and 3D LiDAR annotations (#96)

* add t4 2d-3d merger

Signed-off-by: Shunsuke Miura <[email protected]>

* add missing surface_ann output

Signed-off-by: Shunsuke Miura <[email protected]>

* Update the document, remove unsused codes

Signed-off-by: Shunsuke Miura <[email protected]>

* add error handling, remove unnecessary prints

Signed-off-by: Shunsuke Miura <[email protected]>

* cosmetic change

Signed-off-by: Shunsuke Miura <[email protected]>

* add an output

Signed-off-by: Shunsuke Miura <[email protected]>

* pre-commit

Signed-off-by: Shunsuke Miura <[email protected]>

* Update config/label/attribute.yaml

Co-authored-by: kminoda <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: kminoda <[email protected]>

chore(release): v1.0.8 (#100)

Signed-off-by: Shunsuke Miura <[email protected]>

chore: Speed up preprocessing for rosbag loading in Rosbag2ToNonAnnotatedT4Converter (#101)

* chore: Speed up preprocessing for rosbag loading in Rosbag2ToNonAnnotatedT4Converter

Signed-off-by: Shunsuke Miura <[email protected]>

* pre-commit

Signed-off-by: Shunsuke Miura <[email protected]>

* fix: typo

Signed-off-by: Shunsuke Miura <[email protected]>

* fix to pass the test

Signed-off-by: Shunsuke Miura <[email protected]>

* Update perception_dataset/rosbag2/rosbag2_reader.py

Co-authored-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(rosbag_to_non_annotated_t4): add support for selecting world frame-id (#102)

* add world frame id config

Signed-off-by: Shunsuke Miura <[email protected]>

* revert unnecessary change

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat(rosbag2_to_non_annotated_t4): improve point cloud conversion time. (#105)

* avoid using pointcloud_msg_to_numpy when checking the point num

Signed-off-by: Shunsuke Miura <[email protected]>

* add ros2-numpy, update lib versions

Signed-off-by: Shunsuke Miura <[email protected]>

* use ros2-numpy to convert pointcloud msg

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix error

Signed-off-by: Shunsuke Miura <[email protected]>

* increment the version number

Signed-off-by: Shunsuke Miura <[email protected]>

* fix a bug

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat: add backward compatibility for autoware_auto_msgs (#104)

* feat: add backward compatibility for autoware_auto_msgs

Signed-off-by: kminoda <[email protected]>

* avoid bare except

Signed-off-by: kminoda <[email protected]>

* add pritn

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Revert "feat: add backward compatibility for autoware_auto_msgs (#104)" (#109)

This reverts commit 4ce94fc86c00b008d02265e4387837f14fc1dcf4.

feat: add backward compatibility for autoware_auto_msgs and autoware_msgs (#110)

* feat: add backward compatibility for autoware_auto_msgs and autoware_msgs

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* using awf/autoware_msgs?

Signed-off-by: kminoda <[email protected]>

* fix

Signed-off-by: kminoda <[email protected]>

* fix type

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme

Signed-off-by: kminoda <[email protected]>

* shorten isinstance

Signed-off-by: kminoda <[email protected]>

* remove unnecessary print

Signed-off-by: kminoda <[email protected]>

* update readme

Signed-off-by: kminoda <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Enhance image data handling to support CompressedImage format

- Modify _generate_image_data to accept both np.ndarray and CompressedImage types
- Add image_shape parameter to properly set image dimensions
- Ensure correct saving of CompressedImage data

Signed-off-by: Shunsuke Miura <[email protected]>

Revert "Enhance image data handling to support CompressedImage format"

This reverts commit f7646a1cb643ece3f0d9b1f00c7f955812bcea62.

fix(converter_params): fix type (#113)

Signed-off-by: kminoda <[email protected]>

fix `pandar_msg` dependency (#117)

* fix `pandar_msg` dependency

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(rosbag_to_non_annotated_t4): Enhance image data handling to support CompressedImage format (#115)

* Enhance image data handling to support CompressedImage format

- Modify _generate_image_data to accept both np.ndarray and CompressedImage types
- Add image_shape parameter to properly set image dimensions
- Ensure correct saving of CompressedImage data

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add import

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix(non_annotated_t4_to_deepen): skip frame when some cameras do not exist (#114)

* fix(non_annotated_t4_to_deepen): skip frame when some cameras do not exist

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update perception_dataset/deepen/non_annotated_t4_to_deepen_converter.py

Co-authored-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

docs: update dataset description (#121)

* docs: update dataset format

Signed-off-by: Shunsuke Miura <[email protected]>

* update workflow figure

Signed-off-by: Shunsuke Miura <[email protected]>

* update 2d format description

Signed-off-by: Shunsuke Miura <[email protected]>

* fix indent

Signed-off-by: Shunsuke Miura <[email protected]>

* fix data directory typo

Signed-off-by: Shunsuke Miura <[email protected]>

* apply pre-commit

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

fix: rosbag conversion (#123)

* fix: timestamp for tf_static

Signed-off-by: Shunsuke Miura <[email protected]>

* change sqlite3 to mcap

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "change sqlite3 to mcap"

This reverts commit 27768a0a1c7972265d4901d4006271767c02bec1.

* increment version number

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat: add `tier4-devkit` library (#111)

* feat: add `t4-devkit` library

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of loading tables as dataclass

Signed-off-by: ktro2828 <[email protected]>

* feat: add `filename` property to `SchemaName`

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of retrieving 2D boxes

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of rendering scene

Signed-off-by: ktro2828 <[email protected]>

* build(deps): update dependencies

Signed-off-by: ktro2828 <[email protected]>

* refactor: move files in `utils` into `common`

Signed-off-by: ktro2828 <[email protected]>

* refactor: add functions to covert between us and sec

Signed-off-by: ktro2828 <[email protected]>

* fix: resolve circular import

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of rendering box velocity

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of rendering box uuid

Signed-off-by: ktro2828 <[email protected]>

* fix: fix 2d box is not rendered

Signed-off-by: ktro2828 <[email protected]>

* refactor: update to render only the first 8 characters of uuid

Signed-off-by: ktro2828 <[email protected]>

* refactor: udpate to render velocity always

Signed-off-by: ktro2828 <[email protected]>

* feat: add an option to force to update schema registry

Signed-off-by: ktro2828 <[email protected]>

* docs: update documents

Signed-off-by: ktro2828 <[email protected]>

* chore: update `pyproject.toml`

Signed-off-by: ktro2828 <[email protected]>

* refactor: declare private class for 2D annotations of camera

Signed-off-by: ktro2828 <[email protected]>

* feat: update `view_points` function considering camera distortion

Signed-off-by: ktro2828 <[email protected]>

* refactor: replace point color operation into `distance_color`

Signed-off-by: ktro2828 <[email protected]>

* chore: update dependencies

Signed-off-by: ktro2828 <[email protected]>

* test: add unit testings of `schema`

Signed-off-by: ktro2828 <[email protected]>

* docs: update documents

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of rendering particular instance with `render_instance(...)`

Signed-off-by: ktro2828 <[email protected]>

* style: update docstring

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of rendering pointcloud

Signed-off-by: ktro2828 <[email protected]>

* feat: update annotation label info

Signed-off-by: ktro2828 <[email protected]>

* fix: update to log 2d box synchronize with sample data timestamp

Signed-off-by: ktro2828 <[email protected]>

* style: update docstrings

Signed-off-by: ktro2828 <[email protected]>

* style: update docstring

Signed-off-by: ktro2828 <[email protected]>

* feat: add classmethod named `from_dict` to schema dataclasses

Signed-off-by: ktro2828 <[email protected]>

* feat: add functions to serialize schema dataclasses

Signed-off-by: ktro2828 <[email protected]>

* docs: update README

Signed-off-by: ktro2828 <[email protected]>

* fix: update not to include shortcut fields while serializing

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

build(deps): bump zipp from 3.18.2 to 3.19.1 (#128)

Bumps [zipp](https://github.com/jaraco/zipp) from 3.18.2 to 3.19.1.
- [Release notes](https://github.com/jaraco/zipp/releases)
- [Changelog](https://github.com/jaraco/zipp/blob/main/NEWS.rst)
- [Commits](https://github.com/jaraco/zipp/compare/v3.18.2...v3.19.1)

---
updated-dependencies:
- dependency-name: zipp
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

fix missing transforms3d dependency (#125)

Co-authored-by: Shunsuke Miura <[email protected]>

chore: release v1.0.12 (#130)

Signed-off-by: Shunsuke Miura <[email protected]>

chore: add config yaml (#131)

* add config yaml

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix(t4-devkit): resolve unexpected point normalization (#133)

* fix: remove unexpected normalization

Signed-off-by: ktro2828 <[email protected]>

* refactor: unpack `D` to specific variables

Signed-off-by: ktro2828 <[email protected]>

* fix: stack z values

Signed-off-by: ktro2828 <[email protected]>

* test: add unit testings for `view_points`

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

docs: comlops dataset design (#134)

* update README

Signed-off-by: Shunsuke Miura <[email protected]>

* remove unintended items from calibrated sensor data

Signed-off-by: Shunsuke Miura <[email protected]>

* update ego_pose

Signed-off-by: Shunsuke Miura <[email protected]>

* describe co-mlops format

Signed-off-by: Shunsuke Miura <[email protected]>

* fix typo

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(t4-devkit): remove `SensorChannel` and replace it by `str` (#132)

* feat: remove `SensorChannel` and replace it with `str`

Signed-off-by: ktro2828 <[email protected]>

* docs: update documents

Signed-off-by: ktro2828 <[email protected]>

* fix: invalid method access

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

release v1.0.13 (#135)

Signed-off-by: Shunsuke Miura <[email protected]>

fix(rosbag2_to_non_annotated_t4): decoding pointcloud2 msg (#137)

* fix decoding pointcloud2 msg

Signed-off-by: Shunsuke Miura <[email protected]>

* fix comments

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat(rosbag2_to_non_annotated_t4): support uint8 intensity (#138)

* fix decoding pointcloud2 msg

Signed-off-by: Shunsuke Miura <[email protected]>

* fix comments

Signed-off-by: Shunsuke Miura <[email protected]>

* support uint8

Signed-off-by: Shunsuke Miura <[email protected]>

* remove ros2-numpy from poetry

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

chore: fix push release tag workflow (#143)

Signed-off-by: Shunsuke Miura <[email protected]>

feat: update pydantic version (#139)

* update pydantic version

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shunsuke Miura <[email protected]>

[pre-commit.ci] pre-commit autoupdate (#144)

updates:
- [github.com/igorshubovych/markdownlint-cli: v0.39.0 → v0.41.0](https://github.com/igorshubovych/markdownlint-cli/compare/v0.39.0...v0.41.0)
- [github.com/psf/black: 24.4.2 → 24.8.0](https://github.com/psf/black/compare/24.4.2...24.8.0)
- [github.com/PyCQA/flake8: 7.0.0 → 7.1.1](https://github.com/PyCQA/flake8/compare/7.0.0...7.1.1)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix(utils): add cast for intensity (#129)

Signed-off-by: kminoda <[email protected]>
Co-authored-by: Kenzo Lobos Tsunekawa <[email protected]>

chore: updated installation instructions (follows the ci/cd ones that worked) (#145)

Signed-off-by: Kenzo Lobos-Tsunekawa <[email protected]>

fix(convert_rosbag2_with_gt_to_annotated_t4_tlr): add skip method when no label on TLR (#140)

* fix init value

Signed-off-by: MasatoSaeki <[email protected]>

* add delay_mseg value

Signed-off-by: MasatoSaeki <[email protected]>

* fix *_base in yaml

Signed-off-by: MasatoSaeki <[email protected]>

* add _convert_image for tlr (closed revert #82)

Signed-off-by: MasatoSaeki <[email protected]>

* add skip method when we do not have label

Signed-off-by: MasatoSaeki <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* delete no necessary parameter  in tlr

Signed-off-by: MasatoSaeki <[email protected]>

* get back path in config

Signed-off-by: MasatoSaeki <[email protected]>

* change the way to initialize delay_msec in camera_sensors

Signed-off-by: MasatoSaeki <[email protected]>

* change comment

Signed-off-by: MasatoSaeki <[email protected]>

* add method if sensormode != no_lidar

Signed-off-by: MasatoSaeki <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix data table

Signed-off-by: MasatoSaeki <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: MasatoSaeki <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(non_annotated_t4_tlr_to_deepen): add conversion tool (#142)

* feat(non_annotated_t4_tlr_to_deepen): add conversion tool

Signed-off-by: kminoda <[email protected]>

* update version

Signed-off-by: kminoda <[email protected]>

* remove camera_channels

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tests

Signed-off-by: kminoda <[email protected]>

* update test

Signed-off-by: kminoda <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

Signed-off-by: kminoda <[email protected]>

* dummy fix

Signed-off-by: kminoda <[email protected]>

* dummy commit

Signed-off-by: kminoda <[email protected]>

* update pyproject.toml

Signed-off-by: kminoda <[email protected]>

---------

Signed-off-by: kminoda <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(t4 devkit): add support of saving rendering result as `.rrd` (#146)

* fix: entity path of radar points

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of saving recording result

Signed-off-by: ktro2828 <[email protected]>

* chore: fix rerun version to `0.17.0`

Signed-off-by: ktro2828 <[email protected]>

* feat: update to make directory if the corresponding directory does not exist

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

chode: fix typo of `occlusion` (#151)

Signed-off-by: ktro2828 <[email protected]>

fix(non_annotated_t4_to_deepen): fix frame skipping logic (#153)

* fix skip frame logic

Signed-off-by: Shunsuke Miura <[email protected]>

* increment the version number

Signed-off-by: Shunsuke Miura <[email protected]>

* refactor: extract get_camera_token into a separate function

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

fix(t4-devkit): resolve rendering issues (#155)

feat: support march 2024 RX2 conversion (#120)

* Output topic drop error during initialization

Signed-off-by: Shunsuke Miura <[email protected]>

* Avoid out-of-bounds access in get_lidar_camera_synced_frame_info

Signed-off-by: Shunsuke Miura <[email protected]>

* Enhance image data handling to support CompressedImage format

- Modify _generate_image_data to accept both np.ndarray and CompressedImage types
- Add image_shape parameter to properly set image dimensions
- Ensure correct saving of CompressedImage data

Signed-off-by: Shunsuke Miura <[email protected]>

* add RX2 constants

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

chore: delete `t4-devkit` (#160)

* chore: delete `t4-devkit`

Signed-off-by: ktro2828 <[email protected]>

* docs: update the documentation link of `t4-devkit`

Signed-off-by: ktro2828 <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>

feat: import deepen label functionality (#159)

* add deepen import label script

Signed-off-by: Shunsuke Miura <[email protected]>

* fix bug

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unused code

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

chore: bump to v1.0.16 (#162)

feat: add upload_dataset functionality (#158)

* feat: add upload dataset script

Signed-off-by: Shunsuke Miura <[email protected]>

* formatting

Signed-off-by: Shunsuke Miura <[email protected]>

* fix config yaml

Signed-off-by: Shunsuke Miura <[email protected]>

* add outputting dataset ID list

Signed-off-by: Shunsuke Miura <[email protected]>

* Skip non-zip files when uploading datasets

Signed-off-by: Shunsuke Miura <[email protected]>

* remove unused code

Signed-off-by: Shunsuke Miura <[email protected]>

* add httpx to poetry

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

docs: add automatic_annotation information (#166)

* docs: add automatic_annotation information

Signed-off-by: Shunsuke Miura <[email protected]>

* fix description for automatic_annotation

Signed-off-by: Shunsuke Miura <[email protected]>

* update the description

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

feat(rosbag2_to_non_annotated_t4): support image undistortion option (#156)

* feat(rosbag2_to_non_annotated_t4): support image undistortion option

Signed-off-by: Shunsuke Miura <[email protected]>

* raise error when the camera_info is not found

Signed-off-by: Shunsuke Miura <[email protected]>

* overwrite distortion coefficient when applying undistortion

Signed-off-by: Shunsuke Miura <[email protected]>

* refactor image undistortion and camera info parsing

Signed-off-by: Shunsuke Miura <[email protected]>

* Fix return logic and error handling

Signed-off-by: Shunsuke Miura <[email protected]>

* Update perception_dataset/rosbag2/rosbag2_to_non_annotated_t4_converter.py

Co-authored-by: kminoda <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: kminoda <[email protected]>

docs: update the description of ego_pose coordinate system (#167)

* docs: update the description of ego_pose coordinate system

Signed-off-by: Shunsuke Miura <[email protected]>

* update

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>

fix(rosbag2_to_non_annotated_t4): enhance point_cloud2_to_array to support optional lidar index field (#168)

* enhance point_cloud2_to_array to support optional lidar index field

Signed-off-by: Shunsuke Miura <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add type hints

Signed-off-by: Shunsuke Miura <[email protected]>

---------

Signed-off-by: Shunsuke Miura <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

feat(deepen): add support of converting deepen 2D segmentation annotation (#164)

* TODO: add deepen segmentation conversion

Signed-off-by: ktro2828 <[email protected]>

* feat: add support of converting deepen 2D segmentation annotation

Signed-off-by: ktro2828 <[email protected]>

* chore: update surface labels

Signed-off-by: ktro2828 <[email protected]>

* fix avoid to use `if cam_idx < num_cameras`

Signed-off-by: ktro2828 <[email protected]>

* fix: strip `sensor` instead of `sensor_`

Signed-off-by: ktro2828 <[email protected]>

* chore: update surface.yaml

Signed-off-by: ktro2828 <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: use  field if it has

Signed-off-by: ktro2828 <[email protected]>

* fix: resolve circular import

Signed-off-by: ktro2828 <[email protected]>

* fix: set default of  to

Signed-off-by: ktro2828 <[email protected]>

* fix: update the condition of annotation types

Signed-off-by: ktro2828 <[email protected]>

* Update perception_dataset/deepen/segmentation/painting2d.py

* Update config/label/surface.yaml

* Update config/convert_deepen_to_t4_segmetation_painting_sample.yaml

Co-authored-by: Shintaro Tomie <[email protected]>

* Update config/convert_deepen_to_t4_segmetation_polygon_sample.yaml

Co-authored-by: Shintaro Tomie <[email protected]>

* chore: rename config files

Signed-off-by: ktro2828 <[email protected]>

* feat: update comparing sensor id and camera index

Signed-off-by: ktro2828 <[email protected]>

* feat: update surface labels

Signed-off-by: ktro2828 <[email protected]>

* feat: update comparing sensor index and camera index in painting

Signed-off-by: ktro2828 <[email protected]>

* fix: remove invalid operation

Signed-off-by: ktro2828 <[email protected]>

* Update perception_dataset/deepen/segmentation/polygon2d.py

Co-authored-by: Shintaro Tomie <[email protected]>

* Update perception_dataset/deepen/segmentation/polygon2d.py

Co-authored-by: Shintaro Tomie <[email protected]>

---------

Signed-off-by: ktro2828 <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Shintaro Tomie <[email protected]>

feat: update record classes for CoMLOPs format (#163)

* feat: update record classes for CoMLOPs format

Signed-off-by: ktro2828 <[email protected]>

* ci: update test depends

Signed-off-by: ktro2828 <[email protected]>

* Update perception_dataset/ros2/oxts_msgs/ins_handler.py

Co-authored-by: Shunsuke Miura <[email protected]>

* feat: update acceleration coordinate system in base_link

Signed-off-by: ktro2828 <[email protected]>

* feat: update handling of velocity/omeg…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants