Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Implement RFC-4382 Range Based Read #4381

Merged
merged 112 commits into from
Mar 26, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
112 commits
Select commit Hold shift + click to select a range
8e28864
Save work
Xuanwo Mar 18, 2024
ad9d955
Save
Xuanwo Mar 18, 2024
e2a1a5f
Build pass
Xuanwo Mar 18, 2024
07e908d
Build pass
Xuanwo Mar 18, 2024
d06d49a
Make happy
Xuanwo Mar 18, 2024
55a4969
Save work
Xuanwo Mar 18, 2024
2a637c3
Fix alluxio
Xuanwo Mar 18, 2024
290cf72
Fix atomicserver
Xuanwo Mar 18, 2024
7358475
Fix azblob
Xuanwo Mar 19, 2024
1f8dd5c
Fix azdls
Xuanwo Mar 19, 2024
c69fe3a
Fix azfile
Xuanwo Mar 19, 2024
4ce89f1
Fix b2
Xuanwo Mar 19, 2024
4de8d78
FIx chainsafe
Xuanwo Mar 19, 2024
9742968
Fix cloudflare kv
Xuanwo Mar 19, 2024
12e451f
Fix cos
Xuanwo Mar 19, 2024
0d4ba9a
Fix d1
Xuanwo Mar 19, 2024
c4f5a24
Fix dbfs
Xuanwo Mar 19, 2024
6b7217f
Fix dropbox
Xuanwo Mar 19, 2024
9bf2f50
Fix ftp
Xuanwo Mar 19, 2024
51e0edf
Fix gcs
Xuanwo Mar 19, 2024
d9617b3
Fix gdrive
Xuanwo Mar 19, 2024
f5a5822
Fix ghac
Xuanwo Mar 19, 2024
7b56dac
fix github
Xuanwo Mar 19, 2024
c017f4b
Fix hdfs
Xuanwo Mar 19, 2024
75a0f5b
Fix http
Xuanwo Mar 19, 2024
1c1da49
Fix hf
Xuanwo Mar 19, 2024
c08f2dc
Fix icloud
Xuanwo Mar 19, 2024
22bdad6
Fix ipfs
Xuanwo Mar 19, 2024
40ab28a
Fix ipmfs
Xuanwo Mar 19, 2024
f8c5705
Fix koofr
Xuanwo Mar 19, 2024
62ef0ec
Fix libsql
Xuanwo Mar 19, 2024
98558fb
Fix obs and onedrive
Xuanwo Mar 19, 2024
84a81df
Fix oss
Xuanwo Mar 19, 2024
50ab743
Fix pcloud
Xuanwo Mar 19, 2024
afeecbf
Fix seafile
Xuanwo Mar 19, 2024
3f8895c
Fix services
Xuanwo Mar 19, 2024
2c6b760
Fix vercel artifacts
Xuanwo Mar 19, 2024
4eeff7d
Fix vercel blob
Xuanwo Mar 19, 2024
a7a3522
FIx webdav
Xuanwo Mar 19, 2024
c787295
Fix webhdfs
Xuanwo Mar 19, 2024
1afe1c6
Fix yandex
Xuanwo Mar 19, 2024
f594721
Save current work
Xuanwo Mar 19, 2024
708553d
Fix build
Xuanwo Mar 19, 2024
c6566f2
Fix build
Xuanwo Mar 19, 2024
4ca19ef
Fix build
Xuanwo Mar 20, 2024
e4127d4
Remove not needed files
Xuanwo Mar 20, 2024
5e2666a
Save work
Xuanwo Mar 20, 2024
02c02e6
Build pass!
Xuanwo Mar 20, 2024
d7b5b61
Fix build
Xuanwo Mar 20, 2024
8458c30
Remove not needed api
Xuanwo Mar 20, 2024
3fb9bcb
FIx tests
Xuanwo Mar 20, 2024
8f2c11e
Save new api
Xuanwo Mar 21, 2024
4651e8a
Fix fs
Xuanwo Mar 21, 2024
a7f6c89
Save work
Xuanwo Mar 21, 2024
f23955b
Fix build
Xuanwo Mar 21, 2024
06a095c
refactor bytes range
Xuanwo Mar 21, 2024
9f828d9
Fix build
Xuanwo Mar 21, 2024
197ac27
Save work
Xuanwo Mar 21, 2024
d970761
Save work
Xuanwo Mar 21, 2024
a09efaf
Build pass
Xuanwo Mar 21, 2024
9656d78
Everyone is happy
Xuanwo Mar 21, 2024
3c0dfd3
Format code
Xuanwo Mar 21, 2024
2980077
Fix license
Xuanwo Mar 21, 2024
73076d8
Remove complete
Xuanwo Mar 21, 2024
0d42758
Remove range in OpRead
Xuanwo Mar 21, 2024
76a9aae
Remove not needed read can seek
Xuanwo Mar 22, 2024
d60f467
Fix tests
Xuanwo Mar 22, 2024
9bb1a91
Fix C binding
Xuanwo Mar 22, 2024
a81c30c
Export adapter
Xuanwo Mar 22, 2024
5c851ca
Polish API
Xuanwo Mar 22, 2024
ec81427
Fix c
Xuanwo Mar 22, 2024
ad645d1
FIx naming
Xuanwo Mar 22, 2024
3f62edc
Fix cpp
Xuanwo Mar 22, 2024
1d6b512
revert
Xuanwo Mar 22, 2024
dccd89b
Fix C
Xuanwo Mar 22, 2024
14a9cb1
FIx java
Xuanwo Mar 22, 2024
34344b1
Fix nodejs
Xuanwo Mar 22, 2024
4524f29
Fix ocaml
Xuanwo Mar 22, 2024
a304563
Fix python
Xuanwo Mar 22, 2024
99c428d
Fix oli
Xuanwo Mar 22, 2024
b47ea51
Fix object_store
Xuanwo Mar 22, 2024
9ed506f
Merge branch 'main' into read_at_based
Xuanwo Mar 22, 2024
0e764ea
Fix lock
Xuanwo Mar 22, 2024
c6bf30d
Format java
Xuanwo Mar 22, 2024
7385d73
FIx nodejs
Xuanwo Mar 22, 2024
71dde4b
Fix ocaml
Xuanwo Mar 22, 2024
b9cc40f
Fix build
Xuanwo Mar 22, 2024
583a6e7
Fix test
Xuanwo Mar 22, 2024
8ba1c45
Fix build
Xuanwo Mar 22, 2024
fee4f8f
Make oio::Buffer cheap to clone
Xuanwo Mar 22, 2024
3d66e0f
Fix empty buffer
Xuanwo Mar 25, 2024
9bde47d
Fix tests
Xuanwo Mar 25, 2024
553a297
Fix sftp support
Xuanwo Mar 25, 2024
256dafe
Protect from limit == 0
Xuanwo Mar 25, 2024
6bc85c3
Fix complete reade
Xuanwo Mar 25, 2024
6e14e7b
Fix alluxio
Xuanwo Mar 25, 2024
02b0cc2
Fix logs
Xuanwo Mar 25, 2024
0a020a0
Fix seafile
Xuanwo Mar 25, 2024
94d540f
Fix sftp
Xuanwo Mar 25, 2024
40897bb
Set fail fast to false
Xuanwo Mar 25, 2024
a6fac01
Fix typo
Xuanwo Mar 25, 2024
4566eb0
Fix nodejs test
Xuanwo Mar 25, 2024
93b81d1
Don't fail fast
Xuanwo Mar 25, 2024
506b07a
FIx format
Xuanwo Mar 25, 2024
be35230
Add cap for read
Xuanwo Mar 26, 2024
43272de
Allow ssh error to retry
Xuanwo Mar 26, 2024
bdc6c2d
Disable chainsafe
Xuanwo Mar 26, 2024
6a62b03
Implement connection pool for sftp
Xuanwo Mar 26, 2024
4c6208d
fix retry reader
Xuanwo Mar 26, 2024
0ee9a56
Fix nodejs test
Xuanwo Mar 26, 2024
522ac74
Fix doc tests
Xuanwo Mar 26, 2024
eea26df
FIx nodejs
Xuanwo Mar 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .github/services/sftp/sftp/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,3 +38,4 @@ runs:
OPENDAL_SFTP_KEY=${{ github.workspace }}/fixtures/sftp/test_ssh_key
OPENDAL_SFTP_KNOWN_HOSTS_STRATEGY=accept
EOF

12 changes: 8 additions & 4 deletions .github/workflows/test_behavior.yml
Original file line number Diff line number Diff line change
Expand Up @@ -79,10 +79,11 @@ jobs:

test_core:
name: core / ${{ matrix.os }}
needs: [plan]
needs: [ plan ]
if: fromJson(needs.plan.outputs.plan).components.core
secrets: inherit
strategy:
fail-fast: false
matrix:
include: ${{ fromJson(needs.plan.outputs.plan).core }}
uses: ./.github/workflows/test_behavior_core.yml
Expand All @@ -92,10 +93,11 @@ jobs:

test_binding_java:
name: binding_java / ${{ matrix.os }}
needs: [plan]
needs: [ plan ]
if: fromJson(needs.plan.outputs.plan).components.binding_java
secrets: inherit
strategy:
fail-fast: false
matrix:
include: ${{ fromJson(needs.plan.outputs.plan).binding_java }}
uses: ./.github/workflows/test_behavior_binding_java.yml
Expand All @@ -105,10 +107,11 @@ jobs:

test_binding_python:
name: binding_python / ${{ matrix.os }}
needs: [plan]
needs: [ plan ]
if: fromJson(needs.plan.outputs.plan).components.binding_python
secrets: inherit
strategy:
fail-fast: false
matrix:
include: ${{ fromJson(needs.plan.outputs.plan).binding_python }}
uses: ./.github/workflows/test_behavior_binding_python.yml
Expand All @@ -118,10 +121,11 @@ jobs:

test_binding_nodejs:
name: binding_nodejs / ${{ matrix.os }}
needs: [plan]
needs: [ plan ]
if: fromJson(needs.plan.outputs.plan).components.binding_nodejs
secrets: inherit
strategy:
fail-fast: false
matrix:
include: ${{ fromJson(needs.plan.outputs.plan).binding_nodejs }}
uses: ./.github/workflows/test_behavior_binding_nodejs.yml
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/test_behavior_binding_java.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ jobs:
name: ${{ matrix.cases.service }} / ${{ matrix.cases.setup }}
runs-on: ${{ inputs.os }}
strategy:
fail-fast: false
matrix:
cases: ${{ fromJson(inputs.cases) }}
steps:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/test_behavior_binding_nodejs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ jobs:
name: ${{ matrix.cases.service }} / ${{ matrix.cases.setup }}
runs-on: ${{ inputs.os }}
strategy:
fail-fast: false
matrix:
cases: ${{ fromJson(inputs.cases) }}
steps:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/test_behavior_binding_python.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ jobs:
name: ${{ matrix.cases.service }} / ${{ matrix.cases.setup }}
runs-on: ${{ inputs.os }}
strategy:
fail-fast: false
matrix:
cases: ${{ fromJson(inputs.cases) }}
steps:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/test_behavior_core.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ jobs:
name: ${{ matrix.cases.service }} / ${{ matrix.cases.setup }}
runs-on: ${{ inputs.os }}
strategy:
fail-fast: false
matrix:
cases: ${{ fromJson(inputs.cases) }}
steps:
Expand Down
Loading
Loading