Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

865 incompatible pyarrow version causing issues with parquet file reading in fink science library #866

Merged
merged 4 commits into from
Jul 22, 2024
Merged

865 incompatible pyarrow version causing issues with parquet file reading in fink science library #866

merged 4 commits into from
Jul 22, 2024

Conversation

fjammes
Copy link
Contributor

@fjammes fjammes commented Jul 19, 2024 •
edited
Loading

IMPORTANT: Please create an issue first before opening a Pull Request.
Linked to issue(s): Closes #865

How was this patch tested?

CI for science was launche manually with success.

@fjammes fjammes requested a review from JulienPeloton July 19, 2024 10:35
@fjammes fjammes self-assigned this Jul 19, 2024
@fjammes fjammes linked an issue Jul 19, 2024 that may be closed by this pull request
Incompatible PyArrow version causing issues with Parquet file reading in fink_science library #865
Closed
@fjammes fjammes force-pushed the 865-incompatible-pyarrow-version-causing-issues-with-parquet-file-reading-in-fink_science-library branch 2 times, most recently from 4ad6c5c to ea614df Compare July 19, 2024 13:03
@JulienPeloton
Copy link
Member

@fjammes -- the CI is failing because of a missing file:

Context "kind-kind" modified.
/home/runner/work/_temp/11f0b535-85ed-4074-9992-09ff61e98e76.sh: line 3: /argo-submit.sh: No such file or directory

Can you fix this?

@fjammes fjammes force-pushed the 865-incompatible-pyarrow-version-causing-issues-with-parquet-file-reading-in-fink_science-library branch from ea614df to fc6d18c Compare July 19, 2024 16:33
@JulienPeloton
Copy link
Member

@fjammes - the CI is failing because it cannot find the image:

  Warning  Failed       55m (x4 over 56m)  kubelet            Failed to pull image "gitlab-registry.in2p3.fr/astrolabsoftware/fink/fink-
broker-noscience:v3.1.2-rc1-57-g60a6251": rpc error: code = NotFound desc = failed to pull and unpack image "gitlab-
registry.in2p3.fr/astrolabsoftware/fink/fink-broker-noscience:v3.1.2-rc1-57-g60a6251": failed to resolve reference "gitlab-
registry.in2p3.fr/astrolabsoftware/fink/fink-broker-noscience:v3.1.2-rc1-57-g60a6251": gitlab-registry.in2p3.fr/astrolabsoftware/fink/
fink-broker-noscience:v3.1.2-rc1-57-g60a6251: not found

Problem of reference?

JulienPeloton
JulienPeloton reviewed Jul 22, 2024
View reviewed changes
e2e/argocd.sh Outdated Show resolved Hide resolved
fjammes added 4 commits July 22, 2024 11:38
@fjammes
Improve pip dependencies management
45b3742 
Add Dockerfile to ciux source pathes
Increase parameters management
Add separate log level for spark
Improve build script configuration
@fjammes
Improve fink-broker configuration
bb77542
@fjammes
Fix ciux init in CI
6cf6fa3
@fjammes
Improve fink startup script
51b4070
@fjammes fjammes force-pushed the 865-incompatible-pyarrow-version-causing-issues-with-parquet-file-reading-in-fink_science-library branch from d4bbda4 to 51b4070 Compare July 22, 2024 09:40
@sonarqubecloud SonarQubeCloud
Copy link

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

@fjammes fjammes merged commit cd320d1 into master Jul 22, 2024
16 of 18 checks passed
@fjammes fjammes deleted the 865-incompatible-pyarrow-version-causing-issues-with-parquet-file-reading-in-fink_science-library branch July 22, 2024 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JulienPeloton JulienPeloton JulienPeloton left review comments

Assignees

@fjammes fjammes

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Incompatible PyArrow version causing issues with Parquet file reading in fink_science library
2 participants
@fjammes @JulienPeloton