Skip to content

Commit

Permalink
lint
Browse files Browse the repository at this point in the history
Signed-off-by: Kevin Su <[email protected]>
  • Loading branch information
pingsutw committed Aug 28, 2023
1 parent e5d9f22 commit 8376608
Showing 1 changed file with 10 additions and 10 deletions.
20 changes: 10 additions & 10 deletions examples/basics/basics/folders.py
Original file line number Diff line number Diff line change
Expand Up @@ -53,17 +53,17 @@ def download_files(csv_urls: List[str]) -> FlyteDirectory:
# :::{note}
# You can annotate a FlyteDirectory when you want to download/upload the contents of the directory in batches. For example,
#
# ```{code-block} python
# @task
# def t1(directory: Annotated[FlyteDirectory, BatchSize(10)]) -> Annotated[FlyteDirectory, BatchSize(100)]:
# ...
# return FlyteDirectory(...)
# ```
# ```{code-block}
# @task
# def t1(directory: Annotated[FlyteDirectory, BatchSize(10)]) -> Annotated[FlyteDirectory, BatchSize(100)]:
# ...
# return FlyteDirectory(...)
# ```
#
# In the above example flytekit will download all files from the input `directory` in chunks of 10, i.e. first it
# downloads 10 files, loads them to memory, then writes those 10 to local disk, then it loads the next 10, so on
# and so forth. Similarly, for outputs, in this case flytekit is going to upload the resulting directory in chunks of
# 100.
# In the above example flytekit will download all files from the input `directory` in chunks of 10, i.e. first it
# downloads 10 files, loads them to memory, then writes those 10 to local disk, then it loads the next 10, so on
# and so forth. Similarly, for outputs, in this case flytekit is going to upload the resulting directory in chunks of
# 100.
# :::


Expand Down

0 comments on commit 8376608

Please sign in to comment.