Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking: Enhanced integration with StarRocks #14822

Closed
5 of 6 tasks
neverchanje opened this issue Jan 26, 2024 · 1 comment
Closed
5 of 6 tasks

Tracking: Enhanced integration with StarRocks #14822

neverchanje opened this issue Jan 26, 2024 · 1 comment
Assignees
Milestone

Comments

@neverchanje
Copy link
Contributor

neverchanje commented Jan 26, 2024

We want to enhance the StarRocks sink, providing a full-featured integration and progress the feature toward a more stable phase.
Here is a list of specific tasks:

  • Test the integration with StarRocks v2.5 (2.5.18), which will be the minimum supported version afterwards.
  • Test with StarRocks v3.0 (3.0.9) and v3.1 (3.1.7). Not required to include it in CI.
  • Support multiple MySQL frontend servers. Right now we only support one address.
  • Starting from v2.2, StarRocks introduced the JSON support. Since our minimal supported vesion is v2.5, we can convert complex data types like JSONB into JSON.
  • Refine the error when the user tries to sink a timestamptz column. We should suggest converting timestamptz to timestamp at first.
    For example, "TIMESTAMP WITH TIMEZONE is not supported for Doris sink as Doris doesn't store time values with timezone information. Please convert the column '{}' to TIMESTAMP first."
  • Refine the error for INTERVAL, TIME, and BYTEA.

Once all finished, we'll try to publish on the integration guide in StarRocks's document website.

@xxhZs
Copy link
Contributor

xxhZs commented Jan 29, 2024

Test the multiple MySQL/HTTP frontend servers. our request and fe exchange only two cases, 1. get the table schema. 2. request forwarded to be, tested the fe under the multi-cluster, these two functions, the cluster can be completed by any node, so may not need to implement multiple ports.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants