-
Notifications
You must be signed in to change notification settings - Fork 45
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
3 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,8 +1,8 @@ | ||
# Using Parallelism | ||
|
||
In the Metaflow basics section, you learned about the [`foreach`](/metaflow/basics#foreach) pattern for creating many parallel copies of steps. | ||
You've also learned about how to [use the `@resources`, `@kubernetes`, or `@batch` decorator](http://localhost:3000/scaling/remote-tasks/introduction#requesting-resources-with-resources-decorator) to scale single-node tasks up. | ||
You've also learned about how to [use the `@resources`, `@kubernetes`, or `@batch` decorator](/scaling/remote-tasks/introduction) to scale single-node tasks up. | ||
|
||
In the section, the focus is on how to use Metaflow for parallel computing. There are two places to get started, depending on your interest: | ||
1. Click on [Using GPUs with Metaflow](/scaling/parallel-compute/use-gpus.md) if you want a general primer on using GPUs with Metaflow. This is useful if you want to set up or use your Metaflow deployment to run GPU tasks. | ||
2. Click on [Multi-node Metaflow tasks](/scaling/parallel-compute/multi-node.md) if you want to run more than one copy of a Metaflow step like a foreach, but where the tasks can communicate with each other. This is useful in HPC and distributed training contexts. | ||
1. Click on [Using accelerators with Metaflow](/scaling/compute/use-accelerators.md) if you want a general primer on using GPUs with Metaflow. This is useful if you want to set up or use your Metaflow deployment to run GPU tasks. | ||
2. Click on [Multi-node Metaflow tasks](/scaling/compute/multi-node.md) if you want to run more than one copy of a Metaflow step like a foreach, but where the tasks can communicate with each other. This is useful in HPC and distributed training contexts. | ||