From c7952c2bba8d8069bdc2d777fbae3e7e8d992fad Mon Sep 17 00:00:00 2001 From: Tianhao-Gu Date: Wed, 22 May 2024 16:32:05 -0500 Subject: [PATCH] update readme --- README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index b006c7c..da4a02f 100644 --- a/README.md +++ b/README.md @@ -79,7 +79,10 @@ In addition, the environment variable `SPARK_MASTER_URL` should also be configur ```python from spark.utils import get_spark_session -spark = get_spark_session('TestApp') +spark = get_spark_session(app_name) + +# To build spark session for Delta Lake operations, set the delta_lake parameter to True +spark = get_spark_session(app_name, delta_lake=True) ``` #### Manually Configuring SparkSession/SparkContext