Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
@Tianhao-Gu
Tianhao-Gu committed May 16, 2024
1 parent 10b9338 commit efb94e4
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -59,8 +59,9 @@ sc.stop()

### Spark Session/Context Configuration

When running Spark in the Jupyter notebook container, the `spark.driver.host` configuration is automatically set to
the hostname (`SPARK_DRIVER_HOST`) of the container.
When running Spark in the Jupyter notebook container, the default `spark.driver.host` configuration is set to
the hostname (`SPARK_DRIVER_HOST`) of the container.
In addition, the environment variable `SPARK_MASTER_URL` should also be configured.

#### Example SparkSession Configuration
```python
Expand Down

0 comments on commit efb94e4

Please sign in to comment.