Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor out the Query language from RocksDB #38

Open
cetra3 opened this issue Jul 26, 2017 · 7 comments
Open

Refactor out the Query language from RocksDB #38

cetra3 opened this issue Jul 26, 2017 · 7 comments

Comments

@cetra3
Copy link

cetra3 commented Jul 26, 2017

I have a use case to match JSON responses from a variety of RESTful APIs and other sources. I'd like to be able to use the query language to parse out a single JSON document or even a JSON array.

Is there a way to do this currently? From the source it looks like it has to be in RocksDB to query it.

@vmx
Copy link
Member

vmx commented Jul 27, 2017

@cetra3, that is correct. We use RocksDB for persistence. So you would insert your JSON into Noise and then do a query on the data.

@vmx
Copy link
Member

vmx commented Aug 10, 2017

@cetra3 As there's no plan to remove the RocksDB dependency, is it OK if I close the issue?

@cetra3
Copy link
Author

cetra3 commented Aug 10, 2017

@vmx, sure.

It would be nice to support some other backends (such as postgres + jsonb) in the future, but I understand it would be a huge undertaking.

@cetra3 cetra3 closed this as completed Aug 10, 2017
@Damienkatz Damienkatz reopened this Aug 11, 2017
@Damienkatz
Copy link
Member

We need to do this. The parser should be able to generate AST representation of the query, and from that the rocksdb backend query engine would be generated, or a streaming engine, etc.

@vmx
Copy link
Member

vmx commented Aug 11, 2017

If someone wants to tackle the AST generation, I propose using a parser combinator. It seemed liked a clean/maintainable approach when I did some prototyping.

@cetra3
Copy link
Author

cetra3 commented Aug 11, 2017

I've used POM before for a few things. I'd like to help but I'm not sure where to start

@vmx
Copy link
Member

vmx commented Nov 24, 2017

I've started a parser using LALRPOP (opposed to me recommendation of doing it with a parser combinator). The code is available at https://github.com/vmx/noise-lalrpop.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants