Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Replace AlluxioURI with UfsUrl #17863

Closed
wants to merge 19 commits into from
Closed

Replace AlluxioURI with UfsUrl #17863

wants to merge 19 commits into from

Commits on Jun 14, 2023

  1. an example implementation purely to measure the amount of effort to c… 

    …hange the API
    @jiacheliu3
    jiacheliu3 committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    c5f0a15 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. add a wrapper

    @jiacheliu3
    jiacheliu3 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    ef0c2da View commit details
    Browse the repository at this point in the history

  2. add new class

    @jiacheliu3
    jiacheliu3 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    2f2d3da View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Add refactor of openFile, and other small fix.

    @YichuanSun
    YichuanSun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    781132f View commit details
    Browse the repository at this point in the history

  2. Add the refactor of ls test. Add part of ctor of UfsUrl.java.

    @YichuanSun
    YichuanSun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    7d7f206 View commit details
    Browse the repository at this point in the history

  3. Add part of UfsUrl.java, add a little part of UfsUrlTest.java.

    @YichuanSun
    YichuanSun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    c762773 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. Add ls command refactor version.

    @YichuanSun
    YichuanSun committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    6bf1897 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. fix the double slash dir bug.

    @YichuanSun
    YichuanSun committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    5b320a9 View commit details
    Browse the repository at this point in the history

  2. a backup for further refactor. Next try to solve the root dir problem.

    @YichuanSun
    YichuanSun committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    d3dc6dd View commit details
    Browse the repository at this point in the history

  3. Refactor part of UfsUrl, add method "isAncestorOf".

    @YichuanSun
    YichuanSun committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    d1477b1 View commit details
    Browse the repository at this point in the history

  4. Disable http keep-alive to address maven deps 'Connection Reset' errors 

    ### What changes are proposed in this pull request?
Disable keep-alive for HTTP requests to deal with connection resets when fetching maven deps from central repo. Unable to repro ([ref](https://stackoverflow.com/questions/55899091/maven-retry-dependency-download-if-failed))

### Why are the changes needed?
Trying to address tarball build failures via CI due to maven errors. 

### Does this PR introduce any user facing changes?
no

			pr-link: Alluxio#17864
			change-id: cid-767a7869d93ca2dbaee4e036d2bd7779ab7618e9
    @tieujason330
    tieujason330 authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    043860b View commit details
    Browse the repository at this point in the history

  5. Add metrics for exteranl storage call from alluxio worker 

    ### What changes are proposed in this pull request?

Please outline the changes and how this PR fixes the issue.

### Why are the changes needed?

Please clarify why the changes are needed. For instance,
  1. If you propose a new API, clarify the use case for a new API.
  2. If you fix a bug, describe the bug.

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
  1. change in user-facing APIs
  2. addition or removal of property keys
  3. webui

			pr-link: Alluxio#17866
			change-id: cid-b6c2036ad76c65854135d660a2de1ca486455298
    @beinan
    beinan authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    e192467 View commit details
    Browse the repository at this point in the history

  6. Add metrics for exteranl storage call from alluxio worker 

    ### What changes are proposed in this pull request?

Please outline the changes and how this PR fixes the issue.

### Why are the changes needed?

Please clarify why the changes are needed. For instance,
  1. If you propose a new API, clarify the use case for a new API.
  2. If you fix a bug, describe the bug.

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
  1. change in user-facing APIs
  2. addition or removal of property keys
  3. webui

			pr-link: Alluxio#17866
			change-id: cid-b6c2036ad76c65854135d660a2de1ca486455298
    @beinan
    beinan authored Jul 31, 2023
    Configuration menu
    Copy the full SHA
    7b72ace View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Cherry-pick from the UfsUrl data structure design branch.

    @YichuanSun
    YichuanSun committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    8be2a8d View commit details
    Browse the repository at this point in the history

  2. [DOCFIX] Fix load doc 

    ### What changes are proposed in this pull request?

Fix load cli doc and remove job service doc

### Why are the changes needed?

doc quality
### Does this PR introduce any user facing changes?
na

			pr-link: Alluxio#17868
			change-id: cid-628e4b5b68919245a7bcdbd3ae859c0bdc6a2e5f
    @jja725
    jja725 authored Aug 1, 2023
    Configuration menu
    Copy the full SHA
    d351160 View commit details
    Browse the repository at this point in the history

  3. Cherry-pick from UfsUrl design branch: Delete useless comments and re… 

    …solved todo. Delete UfsUrlUtils.java for it is not be used.
    @YichuanSun
    YichuanSun committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    ce37d65 View commit details
    Browse the repository at this point in the history

  4. Add multipart upload interface & hdfs minicluster test 

    ### What changes are proposed in this pull request?

Add multipart upload interface & 
add HDFS unit tests using HDFS minicluster


### Why are the changes needed?

To increase code quality

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
  1. change in user-facing APIs
  2. addition or removal of property keys
  3. webui

			pr-link: Alluxio#17862
			change-id: cid-e01bdb47bdeb9218354040f69587a3550972bdc5
    @elega
    elega authored Aug 1, 2023
    Configuration menu
    Copy the full SHA
    93082cc View commit details
    Browse the repository at this point in the history

  5. Bug is still exist.

    @YichuanSun
    YichuanSun committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    0966942 View commit details
    Browse the repository at this point in the history

  6. Merge from the newest main branch.

    @YichuanSun
    YichuanSun committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    db73fbc View commit details
    Browse the repository at this point in the history