Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Provide a way for semi-persisting sample data #575

Open
ohltyler opened this issue Jan 22, 2025 · 0 comments
Open

[FEATURE] Provide a way for semi-persisting sample data #575

ohltyler opened this issue Jan 22, 2025 · 0 comments
Labels
feature A new feature for the plugin v3.0.0 Issues targeting release v3.0.0

Comments

@ohltyler
Copy link
Member

ohltyler commented Jan 22, 2025

Currently, sample source data when configuring ingest is only persisted temporarily on client-side. If a user refreshes the page, or navigates away from the page, any input sample data is lost. Additionally, if a user configures ingestion and successfully inputs sample data, but then later makes some change to their ingestion configuration (after refreshing the page or navigating away), the data is also lost. This can make it difficult for a user to re-run any updates to their ingestion flow, as it requires them to go and re-upload the temporary sample source data. In the worst case, they may not have access to that original data, or just simply not remember.

Ideally, any sample data the user provides is persisted in some semi-temporary state, such that users can always refer to it when whey go to update their ingestion flow, even after navigating away from the page.

A few different options to explore include different caching mechanisms, or even providing temporary indices associated to that workflow to index that data.

@ohltyler ohltyler added feature A new feature for the plugin v3.0.0 Issues targeting release v3.0.0 labels Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature A new feature for the plugin v3.0.0 Issues targeting release v3.0.0
Projects
None yet
Development

No branches or pull requests

1 participant