Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to add headers to Kafka Sink #17850

Open
mbombonato opened this issue Jul 29, 2024 · 2 comments
Open

Add support to add headers to Kafka Sink #17850

mbombonato opened this issue Jul 29, 2024 · 2 comments
Assignees
Labels
needs-design Don't start your coding work before a detailed design proposed type/feature user-feedback

Comments

@mbombonato
Copy link

Is your feature request related to a problem? Please describe.

No

Describe the solution you'd like

CREATE SINK kafka_sink AS SELECT
   "user_id", "user_name", "tenant_id"
FROM my_view
WITH (
    connector='kafka',
    properties.bootstrap.server = 'localhost:9092',
    topic='topic',
    primary_key='user_id,tenant_id',
    headers='X-Tenant-Id: tenant_id, X-User-Id: user_id',
    allow.auto.create.topics='true'
)
FORMAT UPSERT ENCODE JSON;

Describe alternatives you've considered

No response

Additional context

I'd also add the possibility to map a jsonb field to it. Like:
"X-User-Id: user.id"

(That would also be great for the primary-key)

@github-actions github-actions bot added this to the release-1.11 milestone Jul 29, 2024
@fuyufjh fuyufjh removed this from the release-2.0 milestone Aug 19, 2024
@xiangjinwu xiangjinwu added the needs-design Don't start your coding work before a detailed design proposed label Aug 19, 2024
Copy link
Contributor

This issue has been open for 60 days with no activity.

If you think it is still relevant today, and needs to be done in the near future, you can comment to update the status, or just manually remove the no-issue-activity label.

You can also confidently close this issue as not planned to keep our backlog clean.
Don't worry if you think the issue is still valuable to continue in the future.
It's searchable and can be reopened when it's time. 😄

@mbombonato
Copy link
Author

This is still relevant. The "Additional Context" is also relevant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-design Don't start your coding work before a detailed design proposed type/feature user-feedback
Projects
None yet
Development

No branches or pull requests

4 participants