Skip to content

Commit

Permalink
Patch for UDF_PYTHON_DEPENDENCIES_FOLDER_NAME. #877
Browse files Browse the repository at this point in the history
  • Loading branch information
EmileSonneveld committed Nov 13, 2024
1 parent 2747a3d commit 5e0f8cb
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion openeogeotrellis/deploy/batch_job.py
Original file line number Diff line number Diff line change
Expand Up @@ -510,7 +510,9 @@ def write_metadata(metadata, metadata_file, job_dir: Path):

logger.info("Writing results to object storage")
for file_path in filter(lambda x: x.is_file(), job_dir.rglob("*")):
if file_path.name == UDF_PYTHON_DEPENDENCIES_FOLDER_NAME:
# TODO: Get list of files to upload from metadata file.
# AFAIK, nothing else is created locally and needs to be uploaded to s3 afterwards.
if UDF_PYTHON_DEPENDENCIES_FOLDER_NAME in str(file_path):
logger.warning(f"Omitting {file_path} as the executors will not be able to access it")
else:
full_path = str(file_path.absolute())
Expand Down

0 comments on commit 5e0f8cb

Please sign in to comment.