Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distcp with snapshots Ozone change #7

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

sadanand48
Copy link
Owner

What changes were proposed in this pull request?

Main changes

  1. Make org.apache.hadoop.ozone.snapshot.SnapshotDiffReport extend org.apache.hadoop.hdfs.protocol.SnapshotDiffReport
  2. Add Ozone's DistcpSync implementation that provides flexibility to use Ozone specific checks/ functions.

Changes to pom.xml

  1. added hadoop-distcp dependency to ozonefs-common
  2. added hadoop-hdfs-client to ozone-common (required to access org.apache.hadoop.hdfs.protocol.SnapshotDiffReport)
  3. update hadoop version to 3.4.0-Snapshot that contains changes for distcp to work with ozone with snapshots.
  4. Had to update kerby.version as it was throwing Dependency convergence error for org.apache.kerby:kerb-core:jar:1.0.1 since latest version of hadoop uses this version.

What is the link to the Apache JIRA

How was this patch tested?

Unit tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant