Skip to content

Commit

Permalink
set last version for spark3
Browse files Browse the repository at this point in the history
  • Loading branch information
Pierrotws committed Sep 8, 2024
1 parent 5f672b7 commit 15e8511
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions roles/spark/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -75,11 +75,11 @@ tdp-master-3
```bash
# Spark 2
export SPARK_CONF_DIR=/etc/spark/conf
spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /opt/tdp/spark/examples/jars/spark-examples_2.11-2.3.5-TDP-0.1.0-SNAPSHOT.jar 100
spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /opt/tdp/spark/examples/jars/spark-examples_2.11-2.3.4-1.0.jar 100

# Spark 3
export SPARK_CONF_DIR=/etc/spark3/conf
spark3-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /opt/tdp/spark3/examples/jars/spark-examples_2.12-3.2.2-TDP-0.1.0-SNAPSHOT.jar 100
spark3-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster /opt/tdp/spark3/examples/jars/spark-examples_2.12-3.2.4-1.0.jar 100
```

### Start a Spark Shell in client mode
Expand Down
2 changes: 1 addition & 1 deletion tdp_vars_defaults/spark3/spark3.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
---
# Spark version
spark_version: spark3
spark_release: spark-3.2.2-0.0-bin-tdp
spark_release: spark-3.2.4-1.0-bin-tdp
spark_dist_file: "{{ spark_release }}.tgz"

# Spark HBase Connector
Expand Down

0 comments on commit 15e8511

Please sign in to comment.