-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix S3 CompleteMultipartUpload and add related UTs #17874
Conversation
520eea5
to
17091b3
Compare
…pload # Conflicts: # dora/tests/src/test/java/alluxio/client/rest/RestApiTest.java
@Jackson-Wang-7 ask for review |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mostly looks good, left some comments.
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/ListMultipartUploadsResult.java
Outdated
Show resolved
Hide resolved
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/CompleteMultipartUploadRequest.java
Show resolved
Hide resolved
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/CompleteMultipartUploadHandler.java
Outdated
Show resolved
Hide resolved
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/S3ObjectTask.java
Outdated
Show resolved
Hide resolved
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/S3RestUtils.java
Outdated
Show resolved
Hide resolved
dora/tests/src/test/java/alluxio/client/rest/S3ClientRestApiTest.java
Outdated
Show resolved
Hide resolved
d4051ec
to
6dc8ed2
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
left a small question
dora/core/server/proxy/src/main/java/alluxio/proxy/s3/ListMultipartUploadsResult.java
Show resolved
Hide resolved
can be closed? |
2fec0ec
to
b597c61
Compare
What changes are proposed in this pull request?
alluxio.proxy.s3.S3ObjectTask.CompleteMultipartUploadTask#validateParts
CompleteMultipartUpload
executes the specified parts with the specified upload ID rather than all parts.initiate / complete / abort MPU and upload part
unit tests.XAttr
Why are the changes needed?
there are problems in validateParts() of complete MPU
we need to fix validateParts() of complete MPU to keep s3 proxy behaviors as consistent with aws as possible.
Does this PR introduce any user facing changes?
can't get the bucket name and object name of the part while executing ListMultipartUploads
now complete MPU's response is like