Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline support parallel decoding plugin of opengauss #30498

Merged
merged 4 commits into from
Mar 18, 2024
Merged

Conversation

azexcy
Copy link
Contributor

@azexcy azexcy commented Mar 15, 2024

Parallel decoder enabled by default after opengauss 3
Fixes: #29554

Changes proposed in this pull request:

  • Pipeline support parallel decoding plugin of opengauss

Before committing this PR, I'm sure that I have checked the following options:

  • My code follows the code of conduct of this project.
  • I have self-reviewed the commit code.
  • I have (or in comment I request) added corresponding labels for the pull request.
  • I have passed maven check locally : ./mvnw clean install -B -T1C -Dmaven.javadoc.skip -Dmaven.jacoco.skip -e.
  • I have made corresponding changes to the documentation.
  • I have added corresponding unit tests for my changes.

@azexcy azexcy added this to the 5.5.0 milestone Mar 15, 2024
@azexcy azexcy force-pushed the og branch 2 times, most recently from 7f92d54 to f99f568 Compare March 15, 2024 05:07
@azexcy
Copy link
Contributor Author

azexcy commented Mar 15, 2024

https://docs-opengauss.osinfra.cn/zh/docs/5.0.0-lite/docs/DeveloperGuide/%E7%A4%BA%E4%BE%8B-%E9%80%BB%E8%BE%91%E5%A4%8D%E5%88%B6%E4%BB%A3%E7%A0%81%E7%A4%BA%E4%BE%8B.html

mpp_decoding

BEGIN 1004573
{"table_name":"public.t_sales","op_type":"INSERT","columns_name":["id","goods_name","sales_date","sales_volume","sales_store"],"columns_type":["integer","character","timestamp without time zone","integer","character"],"columns_val":["1","'aq                  '","'2024-03-14 20:30:58'","2","'d2                  '"],"old_keys_name":[],"old_keys_type":[],"old_keys_val":[]}
COMMIT 1004573 (at 2024-03-14 20:31:12.098179+08) CSN 951909

Parallel decoding plugin

BEGIN CSN: 951909 first_lsn: 5/59825858
{"table_name":"public.t_sales","op_type":"INSERT","columns_name":["id","goods_name","sales_date","sales_volume","sales_store"],"columns_type":["integer","character","timestamp without time zone","integer","character"],"columns_val":["1","'aq                  '","'2024-03-14 20:30:58'","2","'d2                  '"],"old_keys_name":[],"old_keys_type":[],"old_keys_val":[]}
commit xid: 1004573

Copy link
Contributor

@sandynz sandynz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW: Could we put related official openGauss documents in comment

@sandynz sandynz merged commit 5d3e779 into apache:master Mar 18, 2024
24 checks passed
@azexcy azexcy deleted the og branch March 19, 2024 03:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CDC only the mppdb_decoding decoding mode is supported. Parallel decoding is required.
2 participants