[GSProcessing] Create 0.2.1 Dockerfiles

awslabs · Nov 1, 2023 · 4961bb0 · 4961bb0
1 parent 77c1909
commit 4961bb0
Show file tree

Hide file tree

Showing 6 changed files with 3 additions and 120 deletions.
diff --git a/docs/source/gs-processing/usage/emr-serverless.rst b/docs/source/gs-processing/usage/emr-serverless.rst
@@ -213,7 +213,7 @@ as described in :ref:`gsp-upload-data-ref`.
         --execution-role-arn $ROLE \
         --job-driver "${ARGS_JSON}" # Need to surround ARGS_JSON with quotes here to maintain JSON formatting
 
-Ae with the SageMaker example, we need to run a follow-up job to align the output with the
+As with the SageMaker example, we need to run a follow-up job to align the output with the
 expectations of the DistDGL partitioning pipeline. The easiest is to run the job locally
 on an instance with S3 access:
 

diff --git a/docs/source/index.rst b/docs/source/index.rst
@@ -23,6 +23,7 @@ Welcome to the GraphStorm Documentation and Tutorials
    gs-processing/usage/example
    gs-processing/usage/distributed-processing-setup
    gs-processing/usage/amazon-sagemaker
+   gs-processing/usage/emr-serverless
    gs-processing/developer/input-configuration
 
 .. toctree::

diff --git a/graphstorm-processing/docker/0.1.0/emr/Dockerfile.cpu b/graphstorm-processing/docker/0.1.0/emr/Dockerfile.cpu
diff --git a/graphstorm-processing/docker/0.1.0/emr/emr_bootstrap.sh b/graphstorm-processing/docker/0.1.0/emr/emr_bootstrap.sh
diff --git a/...ocker/0.1.0/emr-serverless/Dockerfile.cpu → ...ocker/0.2.1/emr-serverless/Dockerfile.cpu b/...ocker/0.1.0/emr-serverless/Dockerfile.cpu → ...ocker/0.2.1/emr-serverless/Dockerfile.cpu
diff --git a/graphstorm-processing/docker/build_gsprocessing_image.sh b/graphstorm-processing/docker/build_gsprocessing_image.sh
@@ -15,7 +15,7 @@ Available options:
 
 -h, --help          Print this help and exit
 -x, --verbose       Print script debug info (set -x)
--e, --environment   Image execution environment. Must be one of 'emr' or 'sagemaker'. Required.
+-e, --environment   Image execution environment. Must be one of 'emr-serverless' or 'sagemaker'. Required.
 -t, --target        Docker image target, must be one of 'prod' or 'test'. Default is 'test'.
 -p, --path          Path to graphstorm-processing directory, default is the current directory.
 -i, --image         Docker image name, default is 'graphstorm-processing'.