Bug 1990006 - Create an initial ETL workflow for gecko-trace component #8165
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This partially replaces this semiautomatic script that was used to push error failures reported over telemetry to Bugzilla. I marked this as initial because I am unsure if this is recommended to do in BigQuery. The script is doing a post request for each finding to the Bugzilla rest API. |
| @@ -0,0 +1,67 @@ | |||
| CREATE OR REPLACE FUNCTION gecko_trace.build_root_span(spans ARRAY<JSON>) | |||
There was a problem hiding this comment.
If using the Bugzilla rest API is really supported, then I would deploy these UDF's in a gs bucket as a bundled npm package, maybe.
akkomar
requested changes
Sep 30, 2025
michaelvanstraten
force-pushed
the
initial-etl-gecko-trace
branch
from
cdf9606 to
aa5bdad
Compare
|
@akkomar, I don't know if that fixed it, https://app.circleci.com/pipelines/github/mozilla/bigquery-etl/53295 seams to say so. |
michaelvanstraten
force-pushed
the
initial-etl-gecko-trace
branch
from
aa5bdad to
3bd3655
Compare
| @click.option( | ||
| "--output-dir", | ||
| help="Output directory generated SQL is written to.", | ||
| type=click.Path(file_okay=False, path_type=Path), |
There was a problem hiding this comment.
This is only of type pathlib.Path if the parameters are parsed by click.
This patch adds an initial ETL workflow for processing traces collected by the [gecko-trace component](1) from varius Gecko based Firefox products. [1]: https://searchfox.org/firefox-main/source/toolkit/components/gecko-trace
michaelvanstraten
force-pushed
the
initial-etl-gecko-trace
branch
from
3bd3655 to
c6cc58e
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This patch adds an initial ETL workflow for processing traces collected by the gecko-trace component from varius Gecko based Firefox products.
Related Tickets & Documents
https://bugzilla.mozilla.org/show_bug.cgi?id=1990006
https://docs.google.com/document/d/1HIcggXk8EZ7_4x57M20Rc9RmXenmh6cDtQ2KCJClvKo/edit?usp=sharing