Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Just hold latest 10 record of each key or just hold data of 10 minutes ago #277

Open
arezvani opened this issue Aug 11, 2022 · 4 comments
Open

Just hold latest 10 record of each key or just hold data of 10 minutes ago #277

arezvani opened this issue Aug 11, 2022 · 4 comments
Labels
S3

Comments

@arezvani
Copy link

arezvani commented Aug 11, 2022 •
edited
Loading

How can we set in connector config to just hold latest 10 record of each key or just hold data of 10 minutes ago? or partitioning with key and time period.
@ivanyu
Copy link
Contributor

ivanyu commented Aug 11, 2022

Hi @arezvani
Currently, there is no such feature. What is the use case for this?

@arezvani
Copy link
Author

arezvani commented Aug 12, 2022 •
edited
Loading

Hi,
thank you
I want to have latest 10 record of each key or data of 10 minutes ago for some aggregation on data.
@ivanyu

@ivanyu
Copy link
Contributor

ivanyu commented Aug 12, 2022

I understand. This is a relatively complex windowing function. It's unlikely we will implement it in this connector.

@arezvani
Copy link
Author

What's your idea for implementing this?
@ivanyu

@ahmedsobeh ahmedsobeh transferred this issue from Aiven-Open/s3-connector-for-apache-kafka Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
S3
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ivanyu @arezvani @jjaakola-aiven