Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Place data sources (es, csv) behind standardised interface #8

Open
richard-jones opened this issue Dec 13, 2017 · 0 comments
Open

Place data sources (es, csv) behind standardised interface #8

richard-jones opened this issue Dec 13, 2017 · 0 comments

Comments

@richard-jones
Copy link
Member

As use of CSVs as datasources makes its way into edges, we can see there's a disconnect between how all the data sources are used. Components basically need a lot of knowledge about where data is stored and what format it is in, which makes them highly customised to their position. It would be nice to have a standard filtering/aggregating/results interface behind which both es and csvs sit. We would then be able to add other data sources more easily, such as Solr, Lunr, XML, JSON, etc.

Not sure what the right format for that interface is, but I'd probably begin with the ES query and results syntax, and force the other data sources to conform to that via an adaptor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant