Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Historical Data Streams #137

Merged
merged 25 commits into from
Mar 18, 2025
Merged

Historical Data Streams #137

merged 25 commits into from
Mar 18, 2025

Conversation

mfornos
Copy link
Contributor

@mfornos mfornos commented Mar 10, 2025 •
edited
Loading

Generic historical data archiving and streaming.

  • Historic stream support, automatic switch to follow current.
  • Relative and absolute time frames
  • Last N records
  • Retention policies per agent, e.g. keep last 3 months of data

New blocks stream

  • Basic support for finality in block streams

@mfornos mfornos marked this pull request as draft March 10, 2025 17:52
@mfornos mfornos added the server Issues related to the server label Mar 10, 2025
@mfornos mfornos added this to the M4 - Expansion milestone Mar 10, 2025
@mfornos
Copy link
Contributor Author

mfornos commented Mar 11, 2025

NOTE: to improve storage https://github.com/phiresky/sqlite-zstd

@mfornos mfornos marked this pull request as ready for review March 18, 2025 09:15
@mfornos mfornos merged commit f775fc9 into main Mar 18, 2025
1 check passed
@mfornos mfornos deleted the historical-capability branch March 18, 2025 09:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
server Issues related to the server
Projects
None yet
Milestone
M4 - Analytics and Historical Streams
Development

Successfully merging this pull request may close these issues.
1 participant
@mfornos