Skip to content

Pull requests: mosaicml/streaming

New pull request New
27 Open 641 Closed
27 Open 641 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Set epoch_seed_change attribute on SimulationDataset
#840 opened Dec 3, 2024 by srstevenson Loading…
1
3
Add upper bound for prefix_int
#823 opened Nov 5, 2024 by XiaohanZhangCMU Loading…
8 tasks
6
add jpeg quality option
#818 opened Oct 28, 2024 by cabreraalex Loading…
8 tasks
1
12
Update pre-commit requirement from <4,>=2.18.1 to >=2.18.1,<5 dependencies Pull requests that update a dependency file
#797 opened Oct 7, 2024 by dependabot bot Loading…
2
Refactor spanner to avoid creating large array
#773 opened Sep 3, 2024 by XiaohanZhangCMU Loading…
8 tasks done
12
Bump databricks-sdk from 0.29.0 to 0.30.0 dependencies Pull requests that update a dependency file
#761 opened Aug 19, 2024 by dependabot bot Loading…
1
Check file size within LocalUploader
#751 opened Aug 13, 2024 by XiaohanZhangCMU Loading…
8 tasks
1
Heterogeneous
#684 opened May 24, 2024 by XiaohanZhangCMU • Draft
8 tasks
Update google-cloud-storage requirement from <2.11.0,>=2.9.0 to >=2.9.0,<2.17.0 dependencies Pull requests that update a dependency file
#641 opened Mar 25, 2024 by dependabot bot Loading…
1
Column logical (not physical) type and allow_schema_mismatch
#606 opened Feb 22, 2024 by knighton Loading…
10
parallel merge index
#590 opened Feb 5, 2024 by XiaohanZhangCMU Loading…
8 tasks
37
Add varint to MDS
#574 opened Jan 23, 2024 by knighton Loading…
4
Add options to precompute the epoch
#569 opened Jan 20, 2024 by knighton Loading…
Nuke 1) torch dist, 2) shared memory, and 3) filelock
#556 opened Dec 30, 2023 by knighton Loading…
Add fine-grained timings to Writers
#555 opened Dec 30, 2023 by knighton Loading…
Let's blow away dist, and also shared memory
#552 opened Dec 26, 2023 by knighton • Draft
2 of 3 tasks
Parquet streaming [WIP]
#538 opened Dec 15, 2023 by knighton Loading…
Moved local directory creation and existence check from CloudUploader to Writer class
#520 opened Dec 6, 2023 by karan6181 • Draft
8 tasks
"Golden spike" PR
#488 opened Oct 28, 2023 by knighton • Draft
1
Hf ingestion
#483 opened Oct 23, 2023 by XiaohanZhangCMU Loading…
8 tasks
3
Modify dataframe_to_mds to accept streaming DF
#478 opened Oct 20, 2023 by maddiedawson Loading…
8 tasks
1
Training on PQ shards
#443 opened Sep 22, 2023 by knighton Loading…
8 tasks
4
tag shared and temp files with username
#430 opened Sep 11, 2023 by acutkosky Loading…
3 of 8 tasks
1
1
Experiment: much more powerful MDS type system ("DBS").
#384 opened Aug 16, 2023 by knighton • Draft
1
Parallelize StreamingDataset index downloads.
#285 opened Jun 2, 2023 by knighton Loading…
8 tasks
ProTip! no:milestone will show everything without a milestone.