Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pagination Support #80

Open
gotjosh opened this issue Sep 26, 2023 · 1 comment
Open

Pagination Support #80

gotjosh opened this issue Sep 26, 2023 · 1 comment

Comments

@gotjosh
Copy link
Contributor

gotjosh commented Sep 26, 2023

Some providers, such as:

s3

Support parameters such as max-keys or start-after. More in the API reference

gc

Support parameters such as maxResults, pageToken and startOffset. More in the API reference

Have some support that allows us to paginate results when listing items.

Is there room/need for having the client support these? In our case, we have a need to allow client-facing APIs to iterate over 150k keys at a time and as you can expect the experience of having to iterate through all of these keys at once it's not ideal.

In reality, I don't have much data on timings hence filing #79 but I reckon I'd like to get the conversation started on wether this is something we would like to support.

To begin with, I'm open to the idea of having us support this for the three major cloud providers: GCS, AWS and Azure.

@yeya24
Copy link
Contributor

yeya24 commented Oct 20, 2023

I am open to support those parameters!
PR is welcomed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants