fix: support google well-known-types in protobuf

[tabVersion]

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

resolve #10443 #10475

Checklist

• I have written necessary rustdoc comments
• I have added necessary unit tests and integration tests
• I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features Sqlsmith: Sql feature generation #7934).
• My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
• All checks passed in ./risedev check (or alias, ./risedev c)
• My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

Documentation

• My PR contains user-facing changes.

Click here for Documentation

Types of user-facing changes

Please keep the types that apply to your changes, and remove the others.

• Installation and deployment
• Connector (sources & sinks)
• SQL commands, functions, and operators
• RisingWave cluster configuration changes
• Other (please specify in the release note below)

Release note

[tabVersion]

any idea on how to parse the following json into {"header_key1": "wife", "header_key2": "finish"} 🥲

⬇️ generated proto message from json {"header_key1": "wife", "header_key2": "finish"}

Message(
    DynamicMessage {
        desc: MessageDescriptor {
            name: "Struct",
            full_name: "google.protobuf.Struct",
            is_map_entry: false,
            fields: [
                FieldDescriptor {
                    name: "fields",
                    full_name: "google.protobuf.Struct.fields",
                    json_name: "fields",
                    number: 1,
                    kind: google.protobuf.Struct.FieldsEntry,
                    cardinality: Repeated,
                    containing_oneof: None,
                    default_value: None,
                    is_group: false,
                    is_list: false,
                    is_map: true,
                    is_packed: false,
                    supports_presence: false,
                },
            ],
            oneofs: [],
        },
        fields: DynamicMessageFieldSet {
            fields: {
                1: Value(
                    Map(
                        {
                            String(
                                "header_key1",
                            ): Message(
                                DynamicMessage {
                                    desc: MessageDescriptor {
                                        name: "Value",
                                        full_name: "google.protobuf.Value",
                                        is_map_entry: false,
                                        fields: [
                                            FieldDescriptor {
                                                name: "null_value",
                                                full_name: "google.protobuf.Value.null_value",
                                                json_name: "nullValue",
                                                number: 1,
                                                kind: google.protobuf.NullValue,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "number_value",
                                                full_name: "google.protobuf.Value.number_value",
                                                json_name: "numberValue",
                                                number: 2,
                                                kind: double,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "string_value",
                                                full_name: "google.protobuf.Value.string_value",
                                                json_name: "stringValue",
                                                number: 3,
                                                kind: string,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "bool_value",
                                                full_name: "google.protobuf.Value.bool_value",
                                                json_name: "boolValue",
                                                number: 4,
                                                kind: bool,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "struct_value",
                                                full_name: "google.protobuf.Value.struct_value",
                                                json_name: "structValue",
                                                number: 5,
                                                kind: google.protobuf.Struct,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "list_value",
                                                full_name: "google.protobuf.Value.list_value",
                                                json_name: "listValue",
                                                number: 6,
                                                kind: google.protobuf.ListValue,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                        ],
                                        oneofs: [
                                            OneofDescriptor {
                                                name: "kind",
                                                full_name: "google.protobuf.Value.kind",
                                                fields: [
                                                    FieldDescriptor {
                                                        name: "null_value",
                                                        full_name: "google.protobuf.Value.null_value",
                                                        json_name: "nullValue",
                                                        number: 1,
                                                        kind: google.protobuf.NullValue,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "number_value",
                                                        full_name: "google.protobuf.Value.number_value",
                                                        json_name: "numberValue",
                                                        number: 2,
                                                        kind: double,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "string_value",
                                                        full_name: "google.protobuf.Value.string_value",
                                                        json_name: "stringValue",
                                                        number: 3,
                                                        kind: string,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "bool_value",
                                                        full_name: "google.protobuf.Value.bool_value",
                                                        json_name: "boolValue",
                                                        number: 4,
                                                        kind: bool,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "struct_value",
                                                        full_name: "google.protobuf.Value.struct_value",
                                                        json_name: "structValue",
                                                        number: 5,
                                                        kind: google.protobuf.Struct,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "list_value",
                                                        full_name: "google.protobuf.Value.list_value",
                                                        json_name: "listValue",
                                                        number: 6,
                                                        kind: google.protobuf.ListValue,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                ],
                                            },
                                        ],
                                    },
                                    fields: DynamicMessageFieldSet {
                                        fields: {
                                            3: Value(
                                                String(
                                                    "wife",
                                                ),
                                            ),
                                        },
                                    },
                                },
                            ),
                            String(
                                "header_key2",
                            ): Message(
                                DynamicMessage {
                                    desc: MessageDescriptor {
                                        name: "Value",
                                        full_name: "google.protobuf.Value",
                                        is_map_entry: false,
                                        fields: [
                                            FieldDescriptor {
                                                name: "null_value",
                                                full_name: "google.protobuf.Value.null_value",
                                                json_name: "nullValue",
                                                number: 1,
                                                kind: google.protobuf.NullValue,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "number_value",
                                                full_name: "google.protobuf.Value.number_value",
                                                json_name: "numberValue",
                                                number: 2,
                                                kind: double,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "string_value",
                                                full_name: "google.protobuf.Value.string_value",
                                                json_name: "stringValue",
                                                number: 3,
                                                kind: string,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "bool_value",
                                                full_name: "google.protobuf.Value.bool_value",
                                                json_name: "boolValue",
                                                number: 4,
                                                kind: bool,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "struct_value",
                                                full_name: "google.protobuf.Value.struct_value",
                                                json_name: "structValue",
                                                number: 5,
                                                kind: google.protobuf.Struct,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                            FieldDescriptor {
                                                name: "list_value",
                                                full_name: "google.protobuf.Value.list_value",
                                                json_name: "listValue",
                                                number: 6,
                                                kind: google.protobuf.ListValue,
                                                cardinality: Optional,
                                                containing_oneof: Some(
                                                    "kind",
                                                ),
                                                default_value: None,
                                                is_group: false,
                                                is_list: false,
                                                is_map: false,
                                                is_packed: false,
                                                supports_presence: true,
                                            },
                                        ],
                                        oneofs: [
                                            OneofDescriptor {
                                                name: "kind",
                                                full_name: "google.protobuf.Value.kind",
                                                fields: [
                                                    FieldDescriptor {
                                                        name: "null_value",
                                                        full_name: "google.protobuf.Value.null_value",
                                                        json_name: "nullValue",
                                                        number: 1,
                                                        kind: google.protobuf.NullValue,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "number_value",
                                                        full_name: "google.protobuf.Value.number_value",
                                                        json_name: "numberValue",
                                                        number: 2,
                                                        kind: double,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "string_value",
                                                        full_name: "google.protobuf.Value.string_value",
                                                        json_name: "stringValue",
                                                        number: 3,
                                                        kind: string,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "bool_value",
                                                        full_name: "google.protobuf.Value.bool_value",
                                                        json_name: "boolValue",
                                                        number: 4,
                                                        kind: bool,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "struct_value",
                                                        full_name: "google.protobuf.Value.struct_value",
                                                        json_name: "structValue",
                                                        number: 5,
                                                        kind: google.protobuf.Struct,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                    FieldDescriptor {
                                                        name: "list_value",
                                                        full_name: "google.protobuf.Value.list_value",
                                                        json_name: "listValue",
                                                        number: 6,
                                                        kind: google.protobuf.ListValue,
                                                        cardinality: Optional,
                                                        containing_oneof: Some(
                                                            "kind",
                                                        ),
                                                        default_value: None,
                                                        is_group: false,
                                                        is_list: false,
                                                        is_map: false,
                                                        is_packed: false,
                                                        supports_presence: true,
                                                    },
                                                ],
                                            },
                                        ],
                                    },
                                    fields: DynamicMessageFieldSet {
                                        fields: {
                                            3: Value(
                                                String(
                                                    "finish",
                                                ),
                                            ),
                                        },
                                    },
                                },
                            ),
                        },
                    ),
                ),
            },
        },
    },
)

[neverchanje]

@tabVersion Any context? I dont get the point. I thought that it would be straightforward to directly replace a struct with jsonb.

[tabVersion]

@tabVersion Any context? I dont get the point. I thought that it would be straightforward to directly replace a struct with jsonb.

not really, protobuf wraps the json value in a really complex arch.
you may try to find header_key1 and wife in the generated message provided above and see how complex it is.

[github-actions]

This PR has been open for 60 days with no activity. Could you please update the status? Feel free to ping a reviewer if you are waiting for review.