Issues

• Data loss: cache_limit can evict canonical local-only shards when remote=None

  mosaicml/streaming#988 · Filter by author Plachtaa opened on Aug 17, 2026

• Are there any supported patterns for on-the-fly caching?

  mosaicml/streaming#981 · Filter by author polino-fai opened on May 1, 2026

• Not compatible with HF transformers >=5.0.0

  mosaicml/streaming#979 · Filter by author moritzharmel-doordash opened on Mar 12, 2026
  3

• Does MDSWriter release the GIL?

  mosaicml/streaming#978 · Filter by author antspy opened on Mar 1, 2026

• Support one to many mapping?

  enhancement
  mosaicml/streaming#974 · Filter by author antspy opened on Feb 11, 2026

• Support for different OCI object store authentication mechanisms

  enhancement
  mosaicml/streaming#973 · Filter by author psarka opened on Feb 6, 2026

• dataframe_to_mds fails on large datasets due to Worker Disk Exhaustion

  bug
  mosaicml/streaming#970 · Filter by author AbhishekKumarSingh opened on Feb 2, 2026
  1

• Windows absolute paths with drive letters incorrectly parsed as cloud provider schemes

  bug
  mosaicml/streaming#960 · Filter by author tuhlnaa opened on Nov 4, 2025
  1

• merge_index drops full directory path in merged index.json, causing broken shard references and 404s

  bug
  mosaicml/streaming#959 · Filter by author agdhruv opened on Nov 3, 2025
  2

• Performance imporve: mmap and file handler cache

  enhancement
  mosaicml/streaming#958 · Filter by author yezhengmao1 opened on Oct 31, 2025
  2

• Load only a subset of columns

  enhancement
  mosaicml/streaming#926 · Filter by author stevenpav-helm opened on Jun 3, 2025

• Feature request: support for split/Subset-like behavior and shared local cache in StreamingDataset

  enhancement
  mosaicml/streaming#916 · Filter by author Nima-Hs opened on May 15, 2025

• How to sample nearby items while keeping performance?

  mosaicml/streaming#905 · Filter by author c0g opened on Apr 22, 2025

• Allow configuring max_pool_connections on boto3 s3 client

  enhancement
  mosaicml/streaming#902 · Filter by author ouj opened on Apr 19, 2025

• Race Condition in base.shared.get_shm_prefix (possible general SharedMemory issue)

  bug
  mosaicml/streaming#901 · Filter by author nqgl opened on Apr 14, 2025
  8

• Clean up garbage files

  enhancement
  mosaicml/streaming#893 · Filter by author cassanof opened on Apr 2, 2025
  2

• StreamingDataset gives FileExistsError when called with multiprocessing

  bug
  mosaicml/streaming#884 · Filter by author nicolasj92 opened on Mar 10, 2025

• Unable to get mid-epoch resumption working

  bug
  mosaicml/streaming#880 · Filter by author JLenzy opened on Feb 25, 2025

• Streaming Dataset Simulator stops working beyond 10,000 batches

  bug
  mosaicml/streaming#877 · Filter by author mcrchopra opened on Feb 12, 2025
  1

• NCCL Timeouts from Adding More Datasets + Proportion Sampling

  bug
  mosaicml/streaming#876 · Filter by author schopra8 opened on Feb 11, 2025
  6

• [Bug] Incorrect local file path in HfUploader

  bug
  mosaicml/streaming#875 · Filter by author Abhinay1997 opened on Feb 9, 2025

• FileNotFoundError: [Errno 2] No such file or directory: '/tmp/mds_data/train/index.json'

  mosaicml/streaming#873 · Filter by author jitendra986 opened on Feb 7, 2025

• exist_ok mds_kwargs not passable to dataframe_to_mds()

  mosaicml/streaming#871 · Filter by author asukho opened on Jan 31, 2025

• dataframe_to_mds fails with non-nullable ArrayType

  bug
  mosaicml/streaming#870 · Filter by author sthudium25 opened on Jan 30, 2025
  3

• Facing issue with resuming training for saved dataset state (>1 epoch)

  bug
  mosaicml/streaming#869 · Filter by author rodosingh opened on Jan 28, 2025
  3