Skip to content

Commit

Permalink
Merge branch 'master' into arjunsuresh-patch-1
Browse files Browse the repository at this point in the history
  • Loading branch information
arjunsuresh authored Jun 8, 2024
2 parents 00215ef + 89d4289 commit a0bf8da
Show file tree
Hide file tree
Showing 5 changed files with 51 additions and 27 deletions.
2 changes: 2 additions & 0 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
# These owners will be the default owners for everything in the repo.
# Unless a later match takes precedence,they will be requested for review when someone opens a pull request.
* @mlcommons/wg-ck

/CODEOWNERS @mlcommons/staff
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,9 +14,9 @@ Modify the project in your own fork and issue a pull request once you want other
to take a look at what you have done and discuss the proposed changes.
Ensure that cla-bot and other checks pass for your Pull requests.

## CM project coordinator
## CM framework author

* Grigori Fursin (cTuning.org and cKnowledge.org)
* Grigori Fursin ([cKnowledge.org](https://cKnowledge.org) and [cTuning.org](https://cTuning.org))

## CM contributors in alphabetical order (suggestions, feedback, scripts)

Expand Down
29 changes: 14 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,9 +43,9 @@ CK consists of several ongoing sub-projects:

* [Modular Python harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-python)

* [Collective Knowledge Playground](https://access.cKnowledge.org) - an open-source platform to list CM scripts similar to PYPI,
aggregate AI/ML Systems benchmarking results with CM workflows, and organize
[public optimization challenges and reproducibility initiatives](https://access.cknowledge.org/playground/?action=challenges)
* [Collective Knowledge Playground](https://access.cKnowledge.org) - an external platform being developed by [cKnowledge](https://cKnowledge.org)
to list CM scripts similar to PYPI, aggregate AI/ML Systems benchmarking results in a reproducible format with CM workflows,
and organize [public optimization challenges and reproducibility initiatives](https://access.cknowledge.org/playground/?action=challenges)
to find the most performance and cost-effective AI/ML Systems.

* [CK GUI to run modular benchmarks](https://access.cknowledge.org/playground/?action=howtorun) - such benchmarks
Expand All @@ -56,18 +56,11 @@ CK consists of several ongoing sub-projects:

[Apache 2.0](LICENSE.md)

### Copyright

2022-2024 [MLCommons](https://mlcommons.org)

### Motivation behind CK and CM projects

* ACM REP'23 keynote about the MLCommons CM automation framework: [ [slides](https://doi.org/10.5281/zenodo.8105339) ]
* ACM TechTalk'21 about automating research projects: [ [YouTube](https://www.youtube.com/watch?v=7zpeIVwICa4) ] [ [slides](https://learning.acm.org/binaries/content/assets/leaning-center/webinar-slides/2021/grigorifursin_techtalk_slides.pdf) ]

### Documentation

**We plan to rewrite and simplify the CM documentation and tutorials based on user feedback in Q2 2024 - please stay tuned for more details**.
**MLCommons is updating the CM documentation based on user feedback - please stay tuned for more details**.

* [CM Getting Started Guide and FAQ](docs/getting-started.md)
* [Common CM interface to run MLPerf inference benchmarks](docs/mlperf/inference)
Expand All @@ -79,14 +72,20 @@ CK consists of several ongoing sub-projects:
* [CM and CK history](docs/history.md)


### Citing this project

Please use this [BibTex file](citation.bib).

### Acknowledgments

This open-source technology is being developed by the [MLCommons Task Force on Automation and Reproducibility](https://github.com/mlcommons/ck/blob/master/docs/taskforce.md)
as a community effort based on user feedback.
The open-source Collective Knowledge (CK v1,v2) and Collective Mind automation frameworks (CM) were developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind this project from the following presentations:

We would like to thank all [volunteers, collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
for their support, fruitful discussions, and useful feedback!
* ACM REP'23 keynote about the MLCommons CM automation framework: [ [slides](https://doi.org/10.5281/zenodo.8105339) ]
* ACM TechTalk'21 about automating research projects: [ [YouTube](https://www.youtube.com/watch?v=7zpeIVwICa4) ] [ [slides](https://learning.acm.org/binaries/content/assets/leaning-center/webinar-slides/2021/grigorifursin_techtalk_slides.pdf) ]

We would like to thank all
[volunteers, collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
for their support, fruitful discussions, and useful feedback!
We thank the [cTuning foundation](https://cTuning.org), [cKnowledge.org](https://cKnowledge.org)
and [MLCommons](https://mlcommons.org) for sponsoring this project!
21 changes: 21 additions & 0 deletions citation.bib
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
@article{doi:10.1098/rsta.2020.0211,
author = {Fursin, Grigori},
title = {Collective knowledge: organizing research projects as a database of reusable components and portable workflows with common interfaces},
journal = {Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences},
volume = {379},
number = {2197},
pages = {20200211},
year = {2021},
doi = {10.1098/rsta.2020.0211},
URL = {https://royalsocietypublishing.org/doi/abs/10.1098/rsta.2020.0211},
eprint = {https://royalsocietypublishing.org/doi/pdf/10.1098/rsta.2020.0211},
howpublished = {https://doi.org/10.1098/rsta.2020.0211}
}

@misc{acm_rep_23_cm_keynote,
author = {Fursin, Grigori},
year = "2023",
booktitle = "{Keynote at the 1st ACM conference on reproducibility and replicability (ACM REP'23)}",
title = "Collective Mind: toward a common language to facilitate reproducible research and technology transfer",
howpublished = {https://doi.org/10.5281/zenodo.8105339}
}
22 changes: 12 additions & 10 deletions cm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -214,7 +214,7 @@ and how to implement and share new automations in your public or private project

### Documentation

**We plan to rewrite and simplify the CM documentation and tutorials based on user feedback in Q2 2024 - please stay tuned for more details**.
**MLCommons is updating the CM documentation based on user feedback - please stay tuned for more details**.

* [News](../docs/news.md)
* [Getting Started Guide and FAQ](../docs/getting-started.md)
Expand All @@ -228,18 +228,20 @@ and how to implement and share new automations in your public or private project

[Apache 2.0](LICENSE.md)

### Copyright
### Citing this project

2022-2024 [MLCommons](https://mlcommons.org)
Please use this [BibTex file](https://github.com/mlcommons/ck/blob/master/citation.bib).

### Get in touch
### Acknowledgments

Collective Mind workflow automation framework and Collective Knowledge Playground are being developed
by the [MLCommons Task Force on Automation and Reproducibility](https://github.com/mlcommons/ck/blob/master/docs/taskforce.md)
as a community effort. Volunteers are very welcome to help with this community project!
The open-source Collective Knowledge (CK v1,v2) and Collective Mind automation frameworks (CM) were developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind this project from the following presentations:

### Acknowledgments
* ACM REP'23 keynote about the MLCommons CM automation framework: [ [slides](https://doi.org/10.5281/zenodo.8105339) ]
* ACM TechTalk'21 about automating research projects: [ [YouTube](https://www.youtube.com/watch?v=7zpeIVwICa4) ] [ [slides](https://learning.acm.org/binaries/content/assets/leaning-center/webinar-slides/2021/grigorifursin_techtalk_slides.pdf) ]

CK and CM are community projects based on the feedback from our users and MLCommons members.
We would like to thank all [collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
We would like to thank all
[volunteers, collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
for their support, fruitful discussions, and useful feedback!
We thank the [cTuning foundation](https://cTuning.org), [cKnowledge.org](https://cKnowledge.org)
and [MLCommons](https://mlcommons.org) for sponsoring this project!

0 comments on commit a0bf8da

Please sign in to comment.