-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Firebolt Provider #322
Comments
Hi @denimalpaca - just wanted to know which operators can we plan initially, do we have a Firebolt instance set up somewhere which the provider’s team can access? |
For any async operator to be developed, we need a query id (something like a pid which is unique for each query), because we need to be able to poll for the query status on the Triggerer |
Closed by accident -- please ignore. No update on this right now. |
Note that the MVP provider has been built, which should close this feature request: https://registry.astronomer.io/providers/firebolt @phanikumv , regarding your question about async, we are currently working on adding support for it in our Python driver, which will then make it possible to build an async operator. |
@phanikumv is your idea that the async operator would simply run the query async, return the query ID, and be done? Then the polling for the query status would happen via the Airflow scheduler? |
yes @kevinmarr - the async operator would submit the query and defer to the Triggerer, where we would poll for the query status. |
@kevinmarr any update on this ? Do you have an async version of your Python driver |
Is your feature request related to a problem? Please describe.
The Firebolt team is interested in a deeper partnership with Astronomer, including the creation of astronomer-provider operators.
Describe the solution you'd like
Work with the Firebolt team to develop operators that would fall under the astronomer-providers library.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: