Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Request - Domain breakdown for each task #65

Open
RitwikGupta opened this issue Jan 9, 2025 · 1 comment
Open

Request - Domain breakdown for each task #65

RitwikGupta opened this issue Jan 9, 2025 · 1 comment

Comments

@RitwikGupta
Copy link

In the BigCodeBench paper, Section 3 details the domains each task was pulled from along with percentage breakdowns. Can you please provide this mapping? It will help with deeper analysis.
@terryyz
Copy link
Collaborator

terryyz commented Jan 9, 2025

Please refer to I.4 in Appendix. You can also find the files and scripts we used in Issue #31.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@RitwikGupta @terryyz