Help regarding exposing custom metrics using PySpark #1067
milonbhattacharya
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Anyone has an experience publishing custom metrics within the
foreachBatchfunction. The counter and gauges are instantiated and incremented without error, but can't see them on the metrics page exposed by Spark. (localhost:8080//metrics/prometheus/using:
Spark 3.X.X
python_client for prometheus
python 3.10.X
Beta Was this translation helpful? Give feedback.
All reactions