Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support partial update for Cassandra sink #16607

Closed
BugenZhao opened this issue May 7, 2024 · 2 comments
Closed

support partial update for Cassandra sink #16607

BugenZhao opened this issue May 7, 2024 · 2 comments

Comments

@BugenZhao
Copy link
Member

BugenZhao commented May 7, 2024

Is your feature request related to a problem? Please describe.

Users may intend to write a Cassandra sink with a schema of partial columns to perform partial updates. However, we currently require the schema being exactly matched.

Describe the solution you'd like

To perform an update in a Cassandra table, a UPDATE ... SET ... is executed. If a column is not included in the SET clause, it remains unchanged. This allows for partial updates to occur naturally.

Similar to #14363, allow the sink schema to be a subset of the Cassandra table.

Describe alternatives you've considered

No response

Additional context

The feature request is from community.

This is somehow a dual task of #12709, which is about the Cassandra source.

@xxhZs
Copy link
Contributor

xxhZs commented May 9, 2024

For other sinks, if downstream sinks support partial updates, do we need to supported all? If so, do we need user specified options(like starrocks sink), or is it supported by default(like clickhouse sink)

@fuyufjh
Copy link
Member

fuyufjh commented May 14, 2024

I think this is less prior to #16633, but we can do it if have time

@xxhZs xxhZs closed this as completed Jun 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants