Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

"Better Processors" #997

Closed
11 tasks done
neovintage opened this issue Apr 11, 2023 · 4 comments
Closed
11 tasks done

"Better Processors" #997

neovintage opened this issue Apr 11, 2023 · 4 comments
Assignees
@lovromazgon
Labels
feature New feature or request roadmap Planned for a future release
Milestone
0.9.0

Comments

@neovintage
Copy link
Contributor

neovintage commented Apr 11, 2023 •
edited by raulb
Loading

Feature description

Our plan is for the better processor work for 0.8.0 to include.

What we currently aren't planning on including in this first pass:

  • discovery of processor types (stretch goal)
  • open cdc unwrap
  • permanent storage
  • Splitting and combining records
  • Embedded processors
@neovintage neovintage added feature New feature or request triage Needs to be triaged labels Apr 11, 2023
@neovintage neovintage added this to the 0.7.0 milestone Apr 11, 2023
@neovintage neovintage moved this from Triage to Todo in Conduit Main Apr 11, 2023
@maha-hajja maha-hajja removed the triage Needs to be triaged label Apr 12, 2023
@lovromazgon lovromazgon mentioned this issue Jun 1, 2023
Closed
@simonl2002
Copy link
Member

This likely won't be in 0.7.0 but the goal is to start the work on this.

@nassor
Copy link
Contributor

nassor commented Jun 14, 2023 •
edited
Loading

Extra features descriptions:

  • Load Processor as plugins as we do with connectors.
  • Have the Processor interface method Close called when Conduit is turning off, so we can release external resources allocated by the Processor
  • Open Telemetry Support: send & return SpanContext to the processor (and connectors as well).
  • Simple Key/Value storage for processors.

@simonl2002 simonl2002 modified the milestones: 0.7.0, next Jul 18, 2023
@lovromazgon
Copy link
Member

Relevant discussion: #1141

@simonl2002 simonl2002 modified the milestones: 0.8.0, 0.9.0 Oct 30, 2023
@simonl2002 simonl2002 moved this from Todo to Triage in Conduit Main Oct 31, 2023
@lovromazgon lovromazgon moved this from Triage to In Progress in Conduit Main Nov 9, 2023
@lovromazgon lovromazgon self-assigned this Nov 13, 2023
@lovromazgon lovromazgon mentioned this issue Nov 17, 2023
Merged
@lovromazgon lovromazgon added the roadmap Planned for a future release label Dec 1, 2023
@raulb
Copy link
Member

raulb commented Mar 8, 2024

Documentation will be tackled in this other issue #1422.

Closing this issue since yesterday "better processors" was shipped as part of 0.9.0.

@raulb raulb closed this as completed Mar 8, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in Conduit Main Mar 8, 2024
@lovromazgon lovromazgon mentioned this issue Oct 17, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lovromazgon lovromazgon

Labels
feature New feature or request roadmap Planned for a future release
Projects
Conduit Main
Archived in project
Conduit Roadmap
Status: Done
Milestone
0.9.0
Development

No branches or pull requests
6 participants
@neovintage @nassor @simonl2002 @raulb @lovromazgon @maha-hajja