Skip to content

Issues: mosaicml/streaming

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

64 Open 131 Closed
64 Open 131 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Streaming Dataset Simulator stops working beyond 10,000 batches bug Something isn't working
#877 opened Feb 12, 2025 by mcrchopra
1
NCCL Timeouts from Adding More Datasets + Proportion Sampling bug Something isn't working
#876 opened Feb 11, 2025 by schopra8
4
[Bug] Incorrect local file path in HfUploader bug Something isn't working
#875 opened Feb 9, 2025 by Abhinay1997
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/mds_data/train/index.json'
#873 opened Feb 7, 2025 by jitendra986
exist_ok mds_kwargs not passable to dataframe_to_mds()
#871 opened Jan 31, 2025 by asukho
dataframe_to_mds fails with non-nullable ArrayType bug Something isn't working
#870 opened Jan 30, 2025 by sthudium25
2
Facing issue with resuming training for saved dataset state (>1 epoch) bug Something isn't working
#869 opened Jan 28, 2025 by rodosingh
2
Facing issue with improper file renaming while multi-node training in ROCm bug Something isn't working
#868 opened Jan 27, 2025 by rodosingh
4
how about read speed when training, just save on local. compare to use pytorch dataloader
#864 opened Jan 20, 2025 by yja1
1
Error in Streaming Dataset Decompression in Distributed Setting bug Something isn't working
#863 opened Jan 15, 2025 by jasonkrone
2
Expose StreamingDataset world (or world_size and rank) as argument enhancement New feature or request
#854 opened Dec 19, 2024 by lukemelas
Will cache eviction logic take previously-existing shards into account?
#844 opened Dec 5, 2024 by jamin-chen
3
Support for Lance enhancement New feature or request
#832 opened Nov 20, 2024 by oceanusxiv
5
Pipeline Parallelism (Supported? How to?) enhancement New feature or request
#827 opened Nov 14, 2024 by casper-hansen
4
Cannot Load MDS Dataset bug Something isn't working
#824 opened Nov 11, 2024 by naston
40
UnicodeDecodeError: ... Efficient way to debug the dataset with streaming? enhancement New feature or request
#820 opened Nov 1, 2024 by TAYmit
4
write to S3 is very slow bug Something isn't working
#812 opened Oct 25, 2024 by charliedream1
3
Choose JPEG compression level enhancement New feature or request
#811 opened Oct 24, 2024 by cabreraalex
1
1
MosaicML-Streaming on Databricks
#801 opened Oct 10, 2024 by gtmdotme
9
Support for on-the-fly filtering enhancement New feature or request
#800 opened Oct 9, 2024 by ColinToft
1
Make epoch_sample_ids cachable enhancement New feature or request
#792 opened Sep 28, 2024 by janEbert
2
Dataset does not work after stopping training bug Something isn't working
#781 opened Sep 15, 2024 by gluonfield
1
Sparse Numpy Arrays enhancement New feature or request
#780 opened Sep 10, 2024 by Matagi1996
JointWriter: Allow shard file appending bug Something isn't working
#775 opened Sep 5, 2024 by janEbert
2
MemoryError: Unable to allocate bug Something isn't working
#771 opened Sep 2, 2024 by gluonfield
1
ProTip! Mix and match filters to narrow down what you’re looking for.