Skip to content

Commit

Permalink
WIP
Browse files Browse the repository at this point in the history
  • Loading branch information
jecos committed Mar 9, 2024
1 parent 781ae66 commit 5c6204f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion dags/etl_normalize_variants.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
'--study-id', study_id,
'--study-code', '{{ params.study_code }}'
) \
.with_spark_jar('file:///app/variant-task.jar') \
.with_spark_jar('https://github.com/Ferlab-Ste-Justine/etl-cqdg-portal/releases/download/v2.21.5/variant-task.jar') \
.add_spark_conf({
'spark.jars.packages': 'org.apache.hadoop:hadoop-aws:3.3.2,io.delta:delta-core_2.12:2.3.0,io.projectglow:glow-spark3_2.12:1.2.1',
'spark.kubernetes.container.image': 'ferlabcrsj/spark:6916df9ea76364939be282f32a5b2ddacdb3526e',
Expand Down

0 comments on commit 5c6204f

Please sign in to comment.