Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BIGTOP-4045: Enable Parallel Compilation for Multiple Modules in TEZ #1224

Merged
merged 1 commit into from
Jan 5, 2024

Conversation

JiaLiangC
Copy link
Contributor

@JiaLiangC JiaLiangC commented Dec 28, 2023

Description of PR

test on centos7, ubuntu22
./gradlew tez-clean tez-pkg -PbuildThreads=2C

Parallel compilation for Tez requires the introduction of a Tez patch, which can be found at TEZ-4520. This patch is designed to address the issue of Tez not being able to compile in parallel.

How was this patch tested?

image

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
  • Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/

@JiaLiangC
Copy link
Contributor Author

@sekikn @iwasakims
Could you help review this PR?

@JiaLiangC
Copy link
Contributor Author

@iwasakims
In this pull request, the patch for concurrent compilation of Tez has been merged into the Tez master branch. Could you please help review this pull request?
apache/tez#315

Copy link
Member

@iwasakims iwasakims left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. ./gradlew tez-pkg -PbuildThreads=2C worked as expected on Ubuntu 22.04 x86_64. smoke-tests of Tez passed. Thanks, @JiaLiangC.

@iwasakims iwasakims merged commit c7ad8a7 into apache:master Jan 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants