From 3eb02b6d5b80c5c8ff647ac46c723ae1e01e8c5d Mon Sep 17 00:00:00 2001 From: Quentin Anthony Date: Wed, 8 Nov 2023 12:42:56 -0800 Subject: [PATCH 1/2] change version number and add bullet point to README --- README.md | 7 ++++++- setup.py | 2 +- 2 files changed, 7 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 4594d3f7..a45836b4 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,11 @@ MPI4DL is a [HiDL](https://hidl.cse.ohio-state.edu/) project. We encourage you to visit the [HiDL website](https://hidl.cse.ohio-state.edu/) for additional information, the latest performance numbers, and similar projects on high-performance machine and deep learning. For the latest announcements on HiDL projects, [register for the HiDL mailing list](https://hidl.cse.ohio-state.edu/mailinglists/). -# MPI4DL v0.5 + + +## News +**[11/9/2023]** We now support several new spatial parallelism combinations, such as SP+GEMS+LP and SP+GEMS+PP. For a full list of new and existing features, please see [the MPI4DL feature page](http://hidl.cse.ohio-state.edu/features/#MPI4DL) + +# MPI4DL v0.6 The size of image-based DL models regularly grows beyond the memory available on a single processor (we call such models **out-of-core**), and require advanced parallelism schemes to fit within device memory. Further, the massive image sizes required in specialized applications such as medical and satellite imaging can themselves place significant device memory pressure, and require parallelism schemes to process efficiently during training. Finally, the simplest parallelism scheme, [layer parallelism](#layer-parallelism), is highly inefficient. While there are several approaches that have been proposed to address some of the limitations of layer parallelism. However, most studies are performed for low-resolution images that exhibit different characteristics. Compared to low-resolution images, high-resolution images (e.g. digital pathology, satellite imaging) result in higher activation memory and larger tensors, which in turn lead to a larger communication overhead. diff --git a/setup.py b/setup.py index 9f2d9e20..149e4106 100644 --- a/setup.py +++ b/setup.py @@ -20,7 +20,7 @@ setup( name="mpi4dl", - version="0.5", + version="0.6", url="https://github.com/OSU-Nowlab/MPI4DL", license="Apache License 2.0", packages=find_packages(where="src"), From 3b953602b2223971add71231ed09f0981fdb6ab9 Mon Sep 17 00:00:00 2001 From: Quentin Anthony Date: Wed, 8 Nov 2023 12:44:25 -0800 Subject: [PATCH 2/2] Make the News markdown a header 1 --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index a45836b4..70df843c 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ MPI4DL is a [HiDL](https://hidl.cse.ohio-state.edu/) project. We encourage you t -## News +# News **[11/9/2023]** We now support several new spatial parallelism combinations, such as SP+GEMS+LP and SP+GEMS+PP. For a full list of new and existing features, please see [the MPI4DL feature page](http://hidl.cse.ohio-state.edu/features/#MPI4DL) # MPI4DL v0.6