Skip to content

Pull requests: mosaicml/streaming

New pull request New
39 Open 726 Closed
39 Open 726 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Forward exist_ok in dataframe_to_mds
#991 opened Aug 30, 2026 by SiluPanda Loading…
1
simulation: honor multi-epoch batch durations
#990 opened Aug 30, 2026 by SiluPanda Loading…
3 of 8 tasks
Do not evict local-only shards under cache_limit
#989 opened Aug 23, 2026 by gyanu2507 Loading…
1
Fix Windows drive-letter paths misparsed as cloud schemes
#986 opened Jul 16, 2026 by Abhishek21g Loading…
5 of 8 tasks
1
Fix get_shm_prefix follower race until SharedMemory locals are ready
#985 opened Jul 16, 2026 by Abhishek21g Loading…
5 of 8 tasks
1
Fix dataframe_to_mds for non-nullable ArrayType columns
#984 opened Jun 13, 2026 by discobot Loading…
6 of 8 tasks
1
Fix merge_index dropping nested directories from shard paths
#983 opened Jun 13, 2026 by discobot Loading…
6 of 8 tasks
1
Upgrade Transformers to v5
#977 opened Feb 26, 2026 by sumedh-shenoy Loading…
3 of 7 tasks
1
Megatron streaming dataset
#976 opened Feb 12, 2026 by bodsul Loading…
[HF Datasets] Improve file download
#975 opened Feb 11, 2026 by lhoestq Loading…
Update pytest-cov requirement from <7,>=4 to >=4,<8 dependencies Pull requests that update a dependency file python Pull requests that update python code
#972 opened Feb 2, 2026 by dependabot Bot Loading…
Optimise dataframe_to_mds for Large-Scale Datasets via intermediate Aggressive Disk Cleanup and Distributed Metadata Handling
#971 opened Feb 2, 2026 by AbhishekKumarSingh Loading…
2 of 8 tasks
Bump pytest from 8.4.1 to 9.0.2 dependencies Pull requests that update a dependency file python Pull requests that update python code
#969 opened Jan 26, 2026 by dependabot Bot Loading…
Bump pydantic from 2.11.7 to 2.12.5 dependencies Pull requests that update a dependency file python Pull requests that update python code
#968 opened Jan 26, 2026 by dependabot Bot Loading…
Update google-cloud-storage requirement from <3.3.0,>=2.9.0 to >=2.9.0,<3.9.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#967 opened Jan 26, 2026 by dependabot Bot Loading…
Make SparkConnect the data source
#934 opened Jun 25, 2025 by XiaohanZhangCMU Contributor Loading…
8 tasks
Update numpy requirement from <2.2.0,>=1.21.5 to >=1.21.5,<2.3.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#896 opened Apr 7, 2025 by dependabot Bot Loading…
2
Add upper bound for prefix_int
#823 opened Nov 5, 2024 by XiaohanZhangCMU Contributor Loading…
8 tasks
6
add jpeg quality option
#818 opened Oct 28, 2024 by cabreraalex Loading…
8 tasks
1
12
Refactor spanner to avoid creating large array
#773 opened Sep 3, 2024 by XiaohanZhangCMU Contributor Loading…
8 tasks done
12
Heterogeneous
#684 opened May 24, 2024 by XiaohanZhangCMU Contributor • Draft
8 tasks
Column logical (not physical) type and allow_schema_mismatch
#606 opened Feb 22, 2024 by knighton Contributor Loading…
10
parallel merge index
#590 opened Feb 5, 2024 by XiaohanZhangCMU Contributor Loading…
8 tasks
37
Add varint to MDS
#574 opened Jan 23, 2024 by knighton Contributor Loading…
4
Add options to precompute the epoch
#569 opened Jan 20, 2024 by knighton Contributor Loading…
ProTip! Updated in the last three days: updated:>2026-08-27.