Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

archive update mseedindex database #46

Open
crotwell opened this issue Dec 6, 2023 · 1 comment
Open

archive update mseedindex database #46

crotwell opened this issue Dec 6, 2023 · 1 comment

Comments

@crotwell
Copy link

crotwell commented Dec 6, 2023

The combination of ringserver with portable-fdsnws-dataselect and mseedindex makes a nice combination for ingesting data and making it available. But having to run an separate program periodically to index miniseed files seems inefficient. Could the miniseed archiving portion of ringserver directly update the mseedindex time series database as it writes records to file? That would also keep the database up to date regardless of when the data arrived.

@chad-earthscope
Copy link
Collaborator

Could the miniseed archiving portion of ringserver directly update the mseedindex time series database as it writes records to file?

Sure, after all it's just software!

But on a serious note: it's complicated and would be difficult to update an index in near real-time. The index is most useful and efficient when it can present a coherent picture of contiguous time series. mseedindex is designed for mostly static data sets; sure it can update when files change, but the operation is pretty heavy for applying every record written. Instead new logic would likely be better to "extend" index entries efficiently, creating when needed, and that's non-trivial.

I think the concept is a great idea, so this should be left here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants