Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump version to 0.21 #3132

Merged
merged 4 commits into from
Mar 20, 2024
Merged

Bump version to 0.21 #3132

merged 4 commits into from
Mar 20, 2024

Conversation

mvpatel2000
Copy link
Contributor

What does this PR do?

Bumps Composer version.

Also removes deprecated code snippets.

@mvpatel2000 mvpatel2000 requested a review from a team as a code owner March 20, 2024 19:04
@mvpatel2000 mvpatel2000 requested a review from a team as a code owner March 20, 2024 21:05
@mvpatel2000 mvpatel2000 merged commit d7e1b83 into dev Mar 20, 2024
26 checks passed
@mvpatel2000 mvpatel2000 deleted the mvpatel2000/bump-version-021 branch March 20, 2024 21:57
Ghelfi pushed a commit to Ghelfi/composer that referenced this pull request Mar 25, 2024
* bump version to 021

* fix lint

* fix docstring

* remove old ones
mvpatel2000 added a commit that referenced this pull request Apr 2, 2024
* adding _get_dist_sampler function

* apply _get_dist_sampler across all trainer.py

* Switch condition to check if batch_sampler if filled first since sampler is always defined

* adding docstring

* removing antipattenr from _get_sampler and linting

* removed default attrs from exception in the attrs dict (#3126)

* Bump coverage[toml] from 7.4.3 to 7.4.4 (#3121)

Bumps [coverage[toml]](https://github.com/nedbat/coveragepy) from 7.4.3 to 7.4.4.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](nedbat/coveragepy@7.4.3...7.4.4)

---
updated-dependencies:
- dependency-name: coverage[toml]
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Refactor initialization (#3127)

Co-authored-by: practicinginhell <[email protected]>

* Bump databricks sdk version (#3128)

* Update packaging requirement from <23.3,>=21.3.0 to >=21.3.0,<24.1 (#3122)

Updates the requirements on [packaging](https://github.com/pypa/packaging) to permit the latest version.
- [Release notes](https://github.com/pypa/packaging/releases)
- [Changelog](https://github.com/pypa/packaging/blob/main/CHANGELOG.rst)
- [Commits](pypa/packaging@21.3...24.0)

---
updated-dependencies:
- dependency-name: packaging
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mihir Patel <[email protected]>

* remove rng from save weights only ckpt (#3129)

* More compression options (#3118)

* fix documentation about which file extensions perform compression

* refactor tar handling when writing checkpoint files

* add CLI compressor options to checkpoint saving

* update documentation

* restructure CLI compressor handling. Added more tests

* fix skipping test when compressor not installed

* add documentation and fix some code style issues

* use correct file extension for zstd

* add missing full stop

* fix failing tests

* remove type ignore

Co-authored-by: Mihir Patel <[email protected]>

* combine imports into one

* fix capitalisation

Co-authored-by: Mihir Patel <[email protected]>

---------

Co-authored-by: Mihir Patel <[email protected]>

* Only broadcast distcp files (#3130)

* filter

* remove metadata skip

* Bump version to 0.21 (#3132)

* bump version to 021

* fix lint

* fix docstring

* remove old ones

* Adding a test for checking the update of epoch on batch_sampler

* proper formating

* adding _get_dist_sampler function

* apply _get_dist_sampler across all trainer.py

* Switch condition to check if batch_sampler if filled first since sampler is always defined

* adding docstring

* removing antipattenr from _get_sampler and linting

* Adding a test for checking the update of epoch on batch_sampler

* proper formating

* Chang _get_sampler to _get_distributed_sampler to bypass torch default batch_sampler

* Move batch_sampler instanciation for test

* fix batch_sampler setting in eval_loop

* trainer

* fix

* lint

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Jane Zhang <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Practicinginhell <[email protected]>
Co-authored-by: practicinginhell <[email protected]>
Co-authored-by: Daniel King <[email protected]>
Co-authored-by: Mihir Patel <[email protected]>
Co-authored-by: Evan Racah <[email protected]>
Co-authored-by: Matt Broadway <[email protected]>
Co-authored-by: Alexandre Ghelfi <[email protected]>
j316chuck pushed a commit that referenced this pull request May 16, 2024
* bump version to 021

* fix lint

* fix docstring

* remove old ones
j316chuck pushed a commit that referenced this pull request May 16, 2024
* adding _get_dist_sampler function

* apply _get_dist_sampler across all trainer.py

* Switch condition to check if batch_sampler if filled first since sampler is always defined

* adding docstring

* removing antipattenr from _get_sampler and linting

* removed default attrs from exception in the attrs dict (#3126)

* Bump coverage[toml] from 7.4.3 to 7.4.4 (#3121)

Bumps [coverage[toml]](https://github.com/nedbat/coveragepy) from 7.4.3 to 7.4.4.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](nedbat/coveragepy@7.4.3...7.4.4)

---
updated-dependencies:
- dependency-name: coverage[toml]
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Refactor initialization (#3127)

Co-authored-by: practicinginhell <[email protected]>

* Bump databricks sdk version (#3128)

* Update packaging requirement from <23.3,>=21.3.0 to >=21.3.0,<24.1 (#3122)

Updates the requirements on [packaging](https://github.com/pypa/packaging) to permit the latest version.
- [Release notes](https://github.com/pypa/packaging/releases)
- [Changelog](https://github.com/pypa/packaging/blob/main/CHANGELOG.rst)
- [Commits](pypa/packaging@21.3...24.0)

---
updated-dependencies:
- dependency-name: packaging
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mihir Patel <[email protected]>

* remove rng from save weights only ckpt (#3129)

* More compression options (#3118)

* fix documentation about which file extensions perform compression

* refactor tar handling when writing checkpoint files

* add CLI compressor options to checkpoint saving

* update documentation

* restructure CLI compressor handling. Added more tests

* fix skipping test when compressor not installed

* add documentation and fix some code style issues

* use correct file extension for zstd

* add missing full stop

* fix failing tests

* remove type ignore

Co-authored-by: Mihir Patel <[email protected]>

* combine imports into one

* fix capitalisation

Co-authored-by: Mihir Patel <[email protected]>

---------

Co-authored-by: Mihir Patel <[email protected]>

* Only broadcast distcp files (#3130)

* filter

* remove metadata skip

* Bump version to 0.21 (#3132)

* bump version to 021

* fix lint

* fix docstring

* remove old ones

* Adding a test for checking the update of epoch on batch_sampler

* proper formating

* adding _get_dist_sampler function

* apply _get_dist_sampler across all trainer.py

* Switch condition to check if batch_sampler if filled first since sampler is always defined

* adding docstring

* removing antipattenr from _get_sampler and linting

* Adding a test for checking the update of epoch on batch_sampler

* proper formating

* Chang _get_sampler to _get_distributed_sampler to bypass torch default batch_sampler

* Move batch_sampler instanciation for test

* fix batch_sampler setting in eval_loop

* trainer

* fix

* lint

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Jane Zhang <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Practicinginhell <[email protected]>
Co-authored-by: practicinginhell <[email protected]>
Co-authored-by: Daniel King <[email protected]>
Co-authored-by: Mihir Patel <[email protected]>
Co-authored-by: Evan Racah <[email protected]>
Co-authored-by: Matt Broadway <[email protected]>
Co-authored-by: Alexandre Ghelfi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants