Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

preparing BERT MLPerf inference SCC'23 tutorial #974

Merged
merged 10 commits into from
Oct 13, 2023
+3,956 −541
Merged

preparing BERT MLPerf inference SCC'23 tutorial #974

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
46f5bd8
Resnet training script fixes
arjunsuresh Oct 9, 2023
3604b40
Fixes for resnet training
arjunsuresh Oct 10, 2023
895a809
improving reports
gfursin Oct 10, 2023
28703a9
first draft of CM-MLPerf BERT tutorial for SCC
gfursin Oct 13, 2023
233bf09
Merge branch 'mlcommons:master' into master
gfursin Oct 13, 2023
c822469
improving MLPerf BERT inference tutorial for SCC'23
gfursin Oct 13, 2023
c4e86ef
Merge branch 'master' of https://github.com/ctuning/mlcommons-ck
gfursin Oct 13, 2023
200899b
further update
gfursin Oct 13, 2023
09bd1b5
adding BERT accuracy
gfursin Oct 13, 2023
e703567
clean up
gfursin Oct 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions cm-mlops/automation/contributor/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,26 @@
print(r['error'])
```

#### add

* CM CLI: ```cm add contributor``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/contributor/module.py#L54))
* CM CLI with UID: ```cm add contributor,68eae17b590d4f8f``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/contributor/module.py#L54))
* CM Python API:
```python
import cmind

r=cm.access({
'action':'add'
'automation':'contributor,68eae17b590d4f8f'
'out':'con'
```
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/contributor/module.py#L54)
```python
})
if r['return']>0:
print(r['error'])
```

### Maintainers

* [Open MLCommons taskforce on automation and reproducibility](https://cKnowledge.org/mlcommons-taskforce)
40 changes: 30 additions & 10 deletions cm-mlops/automation/experiment/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
*This README is automatically generated - don't edit! Use `README-extra.md` for extra notes!*
*This README is automatically generated - don't edit! See [extra README](README-extra.md) for extra notes!*

### Automation actions

#### test

* CM CLI: ```cm test experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L15))
* CM CLI with UID: ```cm test experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L15))
* CM CLI: ```cm test experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L22))
* CM CLI with UID: ```cm test experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L22))
* CM Python API:
```python
import cmind
Expand All @@ -15,7 +15,7 @@
'automation':'experiment,a0a2d123ef064bcb'
'out':'con'
```
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L15)
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L22)
```python
})
if r['return']>0:
Expand All @@ -24,8 +24,8 @@

#### run

* CM CLI: ```cm run experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L53))
* CM CLI with UID: ```cm run experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L53))
* CM CLI: ```cm run experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L64))
* CM CLI with UID: ```cm run experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L64))
* CM Python API:
```python
import cmind
Expand All @@ -35,7 +35,27 @@
'automation':'experiment,a0a2d123ef064bcb'
'out':'con'
```
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L53)
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L64)
```python
})
if r['return']>0:
print(r['error'])
```

#### rerun

* CM CLI: ```cm rerun experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L416))
* CM CLI with UID: ```cm rerun experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L416))
* CM Python API:
```python
import cmind

r=cm.access({
'action':'rerun'
'automation':'experiment,a0a2d123ef064bcb'
'out':'con'
```
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L416)
```python
})
if r['return']>0:
Expand All @@ -44,8 +64,8 @@

#### replay

* CM CLI: ```cm replay experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L403))
* CM CLI with UID: ```cm replay experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L403))
* CM CLI: ```cm replay experiment``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L439))
* CM CLI with UID: ```cm replay experiment,a0a2d123ef064bcb``` ([add flags (dict keys) from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L439))
* CM Python API:
```python
import cmind
Expand All @@ -55,7 +75,7 @@
'automation':'experiment,a0a2d123ef064bcb'
'out':'con'
```
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L403)
[add keys from this API](https://github.com/mlcommons/ck/tree/master/cm-mlops/automation/experiment/module.py#L439)
```python
})
if r['return']>0:
Expand Down
Loading