Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tests for the datamixing ensuring all reqd datasets are mixed appropriately #375

Merged
merged 2 commits into from
Jan 28, 2025

Conversation

aakankshaduggal
Copy link
Member

No description provided.

@mergify mergify bot added testing Relates to testing ci-failure labels Nov 12, 2024
@bbrowning bbrowning force-pushed the test-b branch 2 times, most recently from 1cb3639 to dd9e9c1 Compare January 22, 2025 15:46
@mergify mergify bot added ci-failure and removed ci-failure labels Jan 22, 2025
aakankshaduggal and others added 2 commits January 22, 2025 11:06
This finishes up the good start here to add new datamixing tests for
phase07 and phase10, ensuring that we are combining the right datasets
and end up with the expected number of output samples in each phase dataset.

Signed-off-by: Ben Browning <[email protected]>
@bbrowning
Copy link
Contributor

@aakankshaduggal I took the liberty of rebasing this on top of the latest changes and tweaking the logic a bit to get things all passing. If you're happy with this, I think we can take it out of draft and get these additional tests in.

@aakankshaduggal
Copy link
Member Author

thanks for adding to this @bbrowning

@aakankshaduggal aakankshaduggal marked this pull request as ready for review January 27, 2025 19:29
@aakankshaduggal aakankshaduggal requested a review from a team January 27, 2025 19:29
Copy link
Contributor

@bbrowning bbrowning left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I give this a detailed look when rebasing it to work with the latest changes, and looks good to me!

@mergify mergify bot added the one-approval label Jan 27, 2025
@bbrowning bbrowning merged commit 63b3bd4 into instructlab:main Jan 28, 2025
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
one-approval testing Relates to testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants