Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: pipeline error handling and CLI return status #4

Merged
merged 3 commits into from
Dec 20, 2024
Merged

Conversation

aballiet
Copy link
Collaborator

No description provided.

aballiet and others added 3 commits December 19, 2024 17:25
* wip

* wip

* Update gorgias.yml

* Update gorgias.yml

* wip

* feat: add destination unnesting for file

* feat: assert schema is provided if unnest set to True

* add test for config parsing unnest

* Update process.py

* chore: test shutdown wait true pending

* chore(fix): cast bizon date columns as string in bq_streaming

* feat: implement stop events, runner status, refacto time partitioning

* fix test

* delete gha

---------

Co-authored-by: Anas El Mhamdi <[email protected]>
* fix: multiprocessing event type

* feat: cli return exist code 1 if pipeline error

* cli raises clickException

* always run pytest on PR
@aballiet aballiet self-assigned this Dec 20, 2024
@aballiet aballiet requested review from anaselmhamdi and a team December 20, 2024 15:02
@anaselmhamdi anaselmhamdi merged commit 034925b into main Dec 20, 2024
1 check passed
@anaselmhamdi anaselmhamdi deleted the gorgias branch December 20, 2024 15:03
aballiet added a commit that referenced this pull request Dec 20, 2024
* feat(cli): raise python error if pipeline error (#3)

* fix: multiprocessing event type

* feat: cli return exist code 1 if pipeline error
---------

Co-authored-by: Anas El Mhamdi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants