Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor streams-bootstrap cleanup jobs as individual HelmApp #398

Merged
merged 32 commits into from
Jan 15, 2024

Conversation

disrupted
Copy link
Member

@disrupted disrupted commented Jan 2, 2024

Depends on #397

extracted the cleanup job needed for streams-bootstrap producer and streams apps to its own HelmApp nested inside the parent component

@disrupted disrupted changed the title Refactor streams-boostrap cleanup Refactor streams-boostrap cleanup jobs as inner HelmApp Jan 2, 2024
Base automatically changed from refactor/helm-nameoverride to v3 January 2, 2024 17:24
@disrupted disrupted changed the title Refactor streams-boostrap cleanup jobs as inner HelmApp Refactor streams-boostrap cleanup jobs as HelmApp Jan 2, 2024
@disrupted disrupted changed the title Refactor streams-boostrap cleanup jobs as HelmApp Refactor streams-boostrap cleanup jobs as individual HelmApp Jan 2, 2024
@disrupted disrupted added type/refactor Refactoring of existing functionality component/pipeline-components Related to pipeline components labels Jan 2, 2024
@disrupted disrupted added this to the v3.0 milestone Jan 2, 2024
@disrupted disrupted marked this pull request as ready for review January 2, 2024 17:30
@disrupted disrupted changed the title Refactor streams-boostrap cleanup jobs as individual HelmApp Refactor streams-bootstrap cleanup jobs as individual HelmApp Jan 2, 2024
@disrupted disrupted marked this pull request as draft January 3, 2024 15:50
@disrupted disrupted added the breaking-change Indicates that this PR introduces a breaking change label Jan 3, 2024
@disrupted disrupted marked this pull request as ready for review January 8, 2024 12:45
sujuka99 added a commit that referenced this pull request Jan 11, 2024
Preceeds #398

---------

Co-authored-by: Salomon Popp <[email protected]>
@sujuka99
Copy link
Contributor

Please document the breaking changes in the migration guide

@@ -2,8 +2,10 @@ helm-app.yaml:
- app-helm-app.yaml
- repo_config-helm-app.yaml
kafka-app.yaml:
- prefix.yaml
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

weird that those weren't there before 😛 nobody noticed

@disrupted disrupted merged commit bd9e135 into v3 Jan 15, 2024
7 checks passed
@disrupted disrupted deleted the refactor/streams-bootstrap-cleanup branch January 15, 2024 08:18
@@ -40,6 +40,22 @@ All Helm-specific parts of the built-in [`KubernetesApp`](../core-concepts/compo
...
```

## [Create StreamsBootstrap component & refactor cleanup jobs as individual HelmApp](https://github.com/bakdata/kpops/pull/398)

Previously the default `KafkaApp` component configured the [streams-bootstrap](https://bakdata.github.io/streams-bootstrap/) Helm Charts. Now, this component is no longer tied to Helm (or Kubernetes). Instead, there is a new `StreamsBootstrap` component that configures the Helm Chart repository for the components that use it, e.g. `StreamsApp` and `ProducerApp`. If you are using non-default values for the Helm Chart repository or version, it has to be updated as shown below.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the point of having KafkaApp then?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

implement the logic related to Kafka, i.e. creation of output topics

disrupted added a commit that referenced this pull request Jan 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking-change Indicates that this PR introduces a breaking change component/pipeline-components Related to pipeline components type/refactor Refactoring of existing functionality
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants