Skip to content

Commit

Permalink
Merge branch 'main' into srs/change-simulator-ui-help-text-to
Browse files Browse the repository at this point in the history
  • Loading branch information
Saaketh Narayan authored Dec 9, 2024
2 parents 13333da + 65f7c22 commit c952dee
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@

<h4><p align='center'>
<a href="https://www.mosaicml.com">[Website]</a>
- <a href="https://streaming.docs.mosaicml.com/en/latest/getting_started/user_guide.html">[Getting Started]</a>
- <a href="https://docs.mosaicml.com/projects/streaming/en/latest/getting_started/quick_start.html">[Quick Start]</a>
- <a href="https://streaming.docs.mosaicml.com/">[Docs]
- <a href="https://www.databricks.com/company/careers/open-positions?department=Mosaic%20AI&location=all">[We're Hiring!]</a>
</p></h4>
Expand Down Expand Up @@ -195,7 +195,8 @@ dataset = StreamingInsideWebVid(local=local, remote=remote, shuffle=True)

Easily experiment with dataset mixtures with [`Stream`](https://docs.mosaicml.com/projects/streaming/en/latest/api_reference/generated/streaming.Stream.html#stream). Dataset sampling can be controlled in relative (proportion) or absolute (repeat or samples terms). During streaming, the different datasets are streamed, shuffled, and mixed seamlessly just-in-time.

```
<!--pytest.mark.skip-->
```python
# mix C4, github code, and internal datasets
streams = [
Stream(remote='s3://datasets/c4', proportion=0.4),
Expand Down
1 change: 0 additions & 1 deletion docs/source/getting_started/quick_start.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ Start training your model with Streaming in just a few steps!
```python
import numpy as np
from PIL import Image
from shutil import rmtree
from uuid import uuid4
from streaming import MDSWriter

Expand Down

0 comments on commit c952dee

Please sign in to comment.