define generated column on CDC table

[yuhao-su]

          this feature does not seem to work with Postgres CDC table

create table courses (*) from pg_mydb table 'public.courses';
ERROR:  Failed to run the query

Caused by these errors (recent errors listed first):
  1: gRPC request to meta service failed: Internal error
  2: failed to validate CDC table
  3: source cannot pass validation: INVALID_ARGUMENT: Primary key mismatch

Originally posted by @mingfang in #14644 (comment)

[StrikeW]

Is this issue the same problem as #14693 ?

[yuhao-su]

Is this issue the same problem as #14693 ?

Those are different issue

[st1page]

Also, the old CDC connector can not support that too.

dev=> create table tt1 (
  pk int,
  v int, v1 int as v+v, 
  PRIMARY KEY (pk)
) with (
  connector = 'postgres-cdc',
  hostname = 'localhost',
  port = '5432',
  username = 'postgres',
  password = '123456',
  database.name = 'postgres',
  schema.name = 'public',
  table.name = 't',
  slot.name = 'tt1_slot',
);
ERROR:  Failed to run the query

Caused by these errors (recent errors listed first):
  1: gRPC request to meta service failed: Internal error
  2: failed to create source worker
  3: failed to create SplitEnumerator
  4: source cannot pass validation
  5: INVALID_ARGUMENT: The publication 'rw_publication' does not cover all columns of the table 'public.t'

[st1page]

Also, the old CDC connector can not support that too.

dev=> create table tt1 (
  pk int,
  v int, v1 int as v+v, 
  PRIMARY KEY (pk)
) with (
  connector = 'postgres-cdc',
  hostname = 'localhost',
  port = '5432',
  username = 'postgres',
  password = '123456',
  database.name = 'postgres',
  schema.name = 'public',
  table.name = 't',
  slot.name = 'tt1_slot',
);
ERROR:  Failed to run the query

Caused by these errors (recent errors listed first):
  1: gRPC request to meta service failed: Internal error
  2: failed to create source worker
  3: failed to create SplitEnumerator
  4: source cannot pass validation
  5: INVALID_ARGUMENT: The publication 'rw_publication' does not cover all columns of the table 'public.t'

fixed in #16522

[github-actions]

This issue has been open for 60 days with no activity.
If you think it is still relevant today, and needs to be done in the near future, you can comment to update the status, or just manually remove the no-issue-activity label.
You can also confidently close this issue as not planned to keep our backlog clean. Don't worry if you think the issue is still valuable to continue in the future. It's searchable and can be reopened when it's time. 😄

[st1page]

open a more detailed issue for cdc table with auto schema mapping #19643