Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(connector): support postgres_sink in rust #19328

Merged
merged 56 commits into from
Nov 28, 2024

fix docs

e57cbd5
Select commit
Loading
Failed to load commit list.
Merged

feat(connector): support postgres_sink in rust #19328

fix docs
e57cbd5
Select commit
Loading
Failed to load commit list.
Task list completed / task-list-completed Started 2024-11-28 01:13:22 ago

3 / 12 tasks completed

9 tasks still to be completed

Details

Required Tasks

Task Status
We convert ScalarAdapter from ScalarImpl. This is for compatibility with postgres types like Uuid, Array. Incomplete
We map pg types from sea_schema (which we use for table schema discovery), to tokio_postgres::Type (which we use for query execution). Incomplete
Check type mapping. Completed
Sink tests. Completed
Type validation tests. Completed
Can use fast path if types don't require ScalarAdapter. Incomplete
Can try pg transactions. Incomplete
Batch DML downstream: #19328 (comment) Incomplete
Use LogSinker trait instead of SinkWriter. Incomplete
Support switch a jdbc sink to pg. Not sure if totally feasible. But it will support more seamless upgrade. Incomplete
I have written necessary rustdoc comments Incomplete
I have added necessary unit tests and integration tests Incomplete
I have added test labels as necessary. See details. Incomplete
I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934). Incomplete
My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future). Incomplete
All checks passed in ./risedev check (or alias, ./risedev c) Incomplete
My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details) Incomplete
My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users) Incomplete