Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka-cdc-sink: Missing name field in debezium json #13450

Closed
xuefengze opened this issue Nov 16, 2023 · 1 comment · Fixed by #13496
Closed

kafka-cdc-sink: Missing name field in debezium json #13450

xuefengze opened this issue Nov 16, 2023 · 1 comment · Fixed by #13496
Assignees
Milestone

Comments

@xuefengze
Copy link
Contributor

According to debezium data type mapping, semantic type(aka. name) describes how the Kafka Connect schema captures the meaning of the field using the name of the Kafka Connect schema for the field.

Example:
In the Risingwave -(Debezium Json)-> Kafka -(Debezium Json)-> JDBC connector -> PostgreSQL pipeline of our implementation, the DATE type in the message event appears like this:

{
  "field": "c_date",
  "optional": true,
  "type": "int32"
}

Well in Debezium PG connector, it appears like this:

{
  "field": "c_date",
  "optional": true,
  "type": "int32",
  "name": "io.debezium.time.Date"
}

If we use debezium jdbc connector, it can automatically convert c_date type to DATE by name. Currently, we are only seeing the c_date type as an integer in PostgreSQL. And we need additional configuration in the JDBC connector to parse c_date, so that we can see the DATE type in PostgreSQL.

@github-actions github-actions bot added this to the release-1.5 milestone Nov 16, 2023
@fuyufjh
Copy link
Member

fuyufjh commented Nov 16, 2023

I am confused by the issue description? 👀

Missing name field in debezium json

So are you proposing to add the name field in the output of kafka debezium sink, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants