Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge release 0.3.0 back to main #635

Merged
merged 7 commits into from
Sep 27, 2023
Merged

Merge release 0.3.0 back to main #635

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
4b4ae7a
update version
dakinggg Sep 26, 2023
779d8af
update branch in mcli yamls
dakinggg Sep 26, 2023
2a9b8ac
Merge branch 'main' into release/v0.3.0
dakinggg Sep 26, 2023
0ef130a
Merge branch 'main' into release/v0.3.0
dakinggg Sep 26, 2023
be03161
Merge branch 'main' into 030-back-to-main
dakinggg Sep 27, 2023
54cbb8b
fix paths
dakinggg Sep 27, 2023
c058e38
Merge branch 'release/v0.3.0' into 030-back-to-main
dakinggg Sep 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion llmfoundry/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,4 +68,4 @@
'TiktokenTokenizerWrapper',
]

__version__ = '0.2.0'
__version__ = '0.3.0'
6 changes: 3 additions & 3 deletions mcli/mcli-1b-eval.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
# git_branch: # Specify your git branch
git_commit: 186dd19888a8c8874584f9e78619f3fb0348309f # TODO: repin after next release
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo

Expand Down Expand Up @@ -33,7 +33,7 @@ parameters:
model_max_length: ${max_seq_len}
model:
name: mpt_causal_lm
init_device: meta
init_device: mixed
dakinggg marked this conversation as resolved.
Show resolved Hide resolved
d_model: 2048
n_heads: 16 # Modified 24->16 so that d_head == 128 to satisfy FlashAttention
n_layers: 24
Expand Down
2 changes: 1 addition & 1 deletion mcli/mcli-1b-max-seq-len-8k.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo
Expand Down
2 changes: 1 addition & 1 deletion mcli/mcli-1b.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo
Expand Down
3 changes: 2 additions & 1 deletion mcli/mcli-benchmark-mpt.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,8 @@ image: mosaicml/pytorch:1.13.1_cu117-python3.10-ubuntu20.04
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: '.[gpu]'

command: |
Expand Down
4 changes: 2 additions & 2 deletions mcli/mcli-convert-composer-to-hf.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e .
ssh_clone: false # Should be true if using a private repo

command: |
cd llm-foundry/llmfoundry/inference
cd llm-foundry/scripts/inference
python convert_composer_to_hf.py \
--composer_path s3://bucket/folder/checkpoint-path.pt \
--hf_output_path s3://bucket/folder/hf/ \
Expand Down
4 changes: 2 additions & 2 deletions mcli/mcli-hf-eval.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e ".[gpu]"
ssh_clone: false # Should be true if using a private repo
Expand All @@ -11,7 +11,7 @@ command: |
composer eval/eval.py /mnt/config/parameters.yaml

# Mosaic Cloud will use run_name (with a unique suffix) to populate the env var $RUN_NAME
run_name: all-eval
run_name: mpt-eval
gpu_num: 8
# gpu_type:
# cluster: # replace with your cluster here!
Expand Down
2 changes: 1 addition & 1 deletion mcli/mcli-hf-generate.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_branch: v0.2.0
git_branch: v0.3.0
# git_commit: # OR use your commit hash
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo
Expand Down
2 changes: 1 addition & 1 deletion mcli/mcli-llama2-finetune.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
integrations:
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
git_commit: 5ec4016b40652557d57a1d4949ad13a65251184b # TODO: repin this after next release
git_branch: v0.3.0
pip_install: -e .[gpu]
ssh_clone: false # Should be true if using a private repo

Expand Down