Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Firebolt Provider #322

Open
denimalpaca opened this issue May 6, 2022 · 7 comments
Open

Add Firebolt Provider #322

denimalpaca opened this issue May 6, 2022 · 7 comments
Labels
feature New feature or request

Comments

@denimalpaca
Copy link

Is your feature request related to a problem? Please describe.
The Firebolt team is interested in a deeper partnership with Astronomer, including the creation of astronomer-provider operators.

Describe the solution you'd like
Work with the Firebolt team to develop operators that would fall under the astronomer-providers library.

Describe alternatives you've considered

Additional context

@denimalpaca denimalpaca added the feature New feature or request label May 6, 2022
@phanikumv
Copy link
Collaborator

Hi @denimalpaca - just wanted to know which operators can we plan initially, do we have a Firebolt instance set up somewhere which the provider’s team can access?

@phanikumv
Copy link
Collaborator

For any async operator to be developed, we need a query id (something like a pid which is unique for each query), because we need to be able to poll for the query status on the Triggerer

@denimalpaca
Copy link
Author

Closed by accident -- please ignore. No update on this right now.

@kevinmarr
Copy link

Note that the MVP provider has been built, which should close this feature request: https://registry.astronomer.io/providers/firebolt

@phanikumv , regarding your question about async, we are currently working on adding support for it in our Python driver, which will then make it possible to build an async operator.

@kevinmarr
Copy link

@phanikumv is your idea that the async operator would simply run the query async, return the query ID, and be done? Then the polling for the query status would happen via the Airflow scheduler?

@phanikumv
Copy link
Collaborator

yes @kevinmarr - the async operator would submit the query and defer to the Triggerer, where we would poll for the query status.

@phanikumv
Copy link
Collaborator

@kevinmarr any update on this ? Do you have an async version of your Python driver

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants