Skip to content

Commit

Permalink
WIP
Browse files Browse the repository at this point in the history
  • Loading branch information
jecos committed Mar 8, 2024
1 parent 2e965ce commit 58a5830
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion dags/etl_normalize_variants.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
.add_spark_conf({
'spark.jars.packages': 'org.apache.hadoop:hadoop-aws:3.3.2,io.delta:delta-core_2.12:2.3.0,io.projectglow:glow-spark3_2.12:1.2.1',
'spark.kubernetes.container.image': 'apache/spark:3.3.3',
'spark.jars.excludes': 'org.apache.httpcomponents:httpcore,org.apache.httpcomponents:httpclientorg.apache.hadoop:hadoop-client'
'spark.jars.excludes': 'org.apache.httpcomponents:httpcore,org.apache.httpcomponents:httpclient,org.apache.hadoop:hadoop-client'
})
def normalize_variant_operator(name):
return normalized_etl.prepend_args(name).operator(
Expand Down

0 comments on commit 58a5830

Please sign in to comment.