Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support unmount and remount in one atomic operation #17984

Merged
merged 4 commits into from
Sep 23, 2023

Conversation

maobaolong
Copy link
Contributor

@maobaolong maobaolong commented Aug 14, 2023

What changes are proposed in this pull request?

Support unmount and mount to another mount point within the same lock

Why are the changes needed?

Support replace ufs for a mount point. The operation is atomic so no user operations should fail due to observing the middle state.

Does this PR introduce any user facing changes?

A new rpc field and cmd options are added.

@maobaolong
Copy link
Contributor Author

@jenoudet Thanks for your review, PTAL.

Copy link
Contributor

@jiacheliu3 jiacheliu3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the work! I added a comment.

MountInfo mountInfo = mMountTable.getMountTable().get(alluxioPath.getPath());
Map<String, String> propertyMap = context.getOptions().getPropertiesMap();
if (mountInfo != null && propertyMap != null
&& Boolean.parseBoolean(propertyMap.get("remount"))) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

per our discussion, let's change this to a new option in mount command

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Copy link
Contributor

@jiacheliu3 jiacheliu3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added some comments, thanks for the work!

@maobaolong
Copy link
Contributor Author

@jiacheliu3 Thank you for the review, PTAL

@maobaolong maobaolong changed the title Support remount Add remount option to update mount api to support change mount point ufs Sep 15, 2023
Copy link
Contributor

@jiacheliu3 jiacheliu3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@jiacheliu3 jiacheliu3 added area-shell Alluxio Command Line Interface type-feature This issue is a feature request labels Sep 15, 2023
@jiacheliu3 jiacheliu3 changed the title Add remount option to update mount api to support change mount point ufs Support unmount and remount in one atomic operation Sep 23, 2023
@jiacheliu3 jiacheliu3 added the breaks-compatibility Potentially breaks forward or backward compatibility label Sep 23, 2023
@jiacheliu3
Copy link
Contributor

alluxio-bot, merge this please

@alluxio-bot alluxio-bot merged commit 957049e into Alluxio:master-2.x Sep 23, 2023
17 checks passed
alluxio-bot added a commit that referenced this pull request Nov 8, 2023
### What changes are proposed in this pull request?
Merge missing commits from master-2.x to main. The commits in 2023/07/01~2023/11/08 from main...master-2.x will be included by this PR.

We do this merge to catch missing fixes from `master-2.x` and catch the train before `main` cuts a release.

#17747 is not cherry picked because tencent cloud EMR doc is removed
#17755 is not cherry picked because DistLoadCliRunner has been removed in 3.x
#17758 is not cherry picked because MonoBlockStore has been removed in 3.x
#17641 is not cherry picked because the PR has already been in main
#17781 is not cherry picked because the PR has already been in main
#17722 is not cherry picked because the alluxio-fuse command has been changed a lot
#17489 is not cherry picked because audit log on master is no longer in 3.x
#17865 is not cherry picked because replication on job service is no longer in 3.x
#17858 is not cherry picked because it is already in main
#18090 is not cherry picked because generate-tarball has been rewritten in 3.x
#18091 is not cherry picked because the change is already in main
#17474 is not cherry picked because reconfiguration feature is not defined in 3.x
#17735 is not cherry picked because MonoBlockStore is no longer in 3.x
#18133 is not cherry picked because the issue is about master metadata and no longer relevant in 3.x
#17910 is not cherry picked because I prefer to do that manually
#17983 is not cherry picked because the web UI has been reworked
#17984 is not cherry picked because Mount/Unmount commands have been reworked in 3.x
#18103 is not cherry picked because worker cache metrics have been reworked in 3.x
#18185 is not cherry picked because the report command has been reworked in 3.x
#18222 is not cherry picked because Mount/Unmount operations have been reworked in 3.x
#18143 is not cherry picked because the change is already in main
#18303 is not cherry picked because the change is already in main
#18208 is not cherry picked because cache metrics have been reworked in 3.x
#17002 is not cherry picked because the owner has been notified separately
#18334 is not cherry picked because the bash scripts have been reworked in 3.x
#18326 is not cherry picked because the owner has been notified separately

			pr-link: #18397
			change-id: cid-dbf8cbb2d9e721a5a0a1e5028a3c9577438a2ac0
maobaolong added a commit to maobaolong/alluxio that referenced this pull request Jan 3, 2024
### What changes are proposed in this pull request?

Support unmount and mount to another mount point within the same lock

### Why are the changes needed?

Support replace ufs for a mount point. The operation is atomic so no user operations should fail due to observing the middle state.

### Does this PR introduce any user facing changes?

A new rpc field and cmd options are added.

			pr-link: Alluxio#17984
			change-id: cid-d96b4df7d24ab1082e46e6d5a72563534714a48f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-shell Alluxio Command Line Interface breaks-compatibility Potentially breaks forward or backward compatibility type-feature This issue is a feature request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants