Skip to content

Add env var for configuring the maximum number of processes to use for dataset processing #8350

Add env var for configuring the maximum number of processes to use for dataset processing

Add env var for configuring the maximum number of processes to use for dataset processing #8350

Workflow file for this run

name: Code Quality Checks
on:
push:
branches:
- main
- release/**
pull_request:
branches:
- main
- release/**
workflow_call:
workflow_dispatch:
# Cancel old runs when a new commit is pushed to the same branch if not on main or dev
concurrency:
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
cancel-in-progress: ${{ github.ref != 'refs/heads/main' }}
defaults:
run:
working-directory: .
jobs:
code-quality:
runs-on: linux-ubuntu-latest
timeout-minutes: 30
strategy:
matrix:
python_version:
- "3.9"
- "3.10"
pip_deps:
- "[dev]"
steps:
- uses: actions/checkout@v3
- name: Get composite run steps repository
uses: actions/checkout@v3
with:
repository: mosaicml/ci-testing
ref: v0.2.2
path: ./ci-testing
- uses: ./ci-testing/.github/actions/code-quality
with:
python_version: ${{ matrix.python_version }}
pip_deps: ${{ matrix.pip_deps }}