Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: provide basic support for IoTDB as time series storage #2835

Merged
merged 9 commits into from
May 15, 2024

Conversation

bossenti
Copy link
Contributor

@bossenti bossenti commented May 7, 2024

Purpose

This PR introduces very basic and experimental support for IoTDB as time series store for StreamPipes. By default, InfluxDB is still the time series storage of choice but by setting the following environment variables IoTDB can be used as storage.

  • SP_TS_STORAGE: iotdb
  • SP_TS_STORAGE_HOST: <THE-HOST-OF-YOUR-IOTDB-INSTANCE>
  • SP_TS_STORAGE_PORT: <THE-PORT-OF-YOUR-IOTDB-INSTANCE>

These need to be set in the core and the extensions services.

Important

As of now this only supports persisting data into IoTDB via the Data Lake sink. Several other functionalities are not yet implemented and cause breakages, e.g., in the Data Explorer. These functionalities will be provided with upcoming PRs.

Remarks

PR introduces (a) breaking change(s): no

PR introduces (a) deprecation(s): no

@bossenti bossenti added this to the 0.97.0 milestone May 7, 2024
@github-actions github-actions bot added dependencies Pull requests that update a dependency file java Pull requests that update Java code backend Everything that is related to the StreamPipes backend testing Relates to any kind of test (unit test, integration, or E2E test). labels May 7, 2024
@github-actions github-actions bot added the pipeline elements Relates to pipeline elements label May 7, 2024
@tenthe tenthe self-requested a review May 15, 2024 05:29
@bossenti bossenti merged commit 585e63f into dev May 15, 2024
21 checks passed
@bossenti bossenti deleted the basic-iotdb-support branch May 15, 2024 06:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Everything that is related to the StreamPipes backend dependencies Pull requests that update a dependency file java Pull requests that update Java code pipeline elements Relates to pipeline elements testing Relates to any kind of test (unit test, integration, or E2E test).
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants