Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add fast transient module to the science pipeline #757

Merged
merged 2 commits into from
Nov 27, 2023

Conversation

FusRoman
Copy link
Contributor

IMPORTANT: Please create an issue first before opening a Pull Request.
Linked to issue(s): Closes #756

What changes were proposed in this pull request?

How is the issue this PR is referenced against solved with this PR?

How was this patch tested?

@FusRoman
Copy link
Contributor Author

I think we need to upgrade the fink-science requirement with the last version to make tests work.

Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@JulienPeloton JulienPeloton changed the base branch from master to issue/758/bug November 27, 2023 08:23
@JulienPeloton JulienPeloton merged commit 4e20e5b into issue/758/bug Nov 27, 2023
15 of 19 checks passed
JulienPeloton added a commit that referenced this pull request Nov 28, 2023
* Add explicitly mode in the executePlan args

* Fix typo

* use ticks for name when hsing SQL commands

* Expand PYTHONPATH

* Fix syntax

* hardcode py4j version for test

* Missing dollar when updating ENV

* Update CAST with ALIAS

* Try hadoop3 compiled jar in prod (warning: we still have hbase 2.2 whereas the jar is compiled for hbase 2.4)

* Try hadoop3 compiled jar in prod (warning: we still have hbase 2.2 whereas the jar is compiled for hbase 2.4)

* Bump shaded jar

* Disable PROD workflow to test the hypothesis that HBase 2.2 is not compatible with Hadoop 3

* Manually add deps on Json4s

* Manually add deps on Json4s

* Manually add deps on scala JSON

* Manually add deps on scala JSON

* New HBase connectors

* Add slf4j dependency explicitly

* Add slf4j-simple dependency explicitly

* Downgrade slf4j deps

* Use ALIAS when selecting casted columns

* Upgrade to Spark 3.4.1 on kubernetes

* Automatic generation of the SSOFT (#760)

* New bin to generate the SSOFT

* Update args

* Update type of frac

* Missing deps

* Missing deps

* Fix bug in the argument name

* Fix typo

* Take the number of cores differently

* PEP89

* add fast transient module to the science pipeline (#757)

* add fast transient module to the science pipeline

* fix DataFrame

---------

Co-authored-by: FusRoman <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add fast transient science module
2 participants