Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Label metrics by endpoint not path #978

Merged
merged 1 commit into from
Dec 5, 2023
Merged

Label metrics by endpoint not path #978

merged 1 commit into from
Dec 5, 2023

Conversation

benjimin
Copy link
Contributor

@benjimin benjimin commented Dec 5, 2023

Metrics are not logs!

Currently, OWS pods are exporting ~5k metrics each due to a misconfiguration, unreasonably requiring Prometheus to retain multiple separate time-series per HTTP path. High cardinality information (individual HTTP paths) belongs in logs but not metrics.

This change makes OWS consistent with datacube-explorer:
opendatacube/datacube-explorer@6051dd6


📚 Documentation preview 📚: https://datacube-ows--978.org.readthedocs.build/en/978/

Metrics are not logs!

Currently, OWS pods are exporting ~5k metrics each due to a misconfiguration, unreasonably requiring Prometheus to retain multiple separate time-series per HTTP path. High cardinality information (individual HTTP paths) belong in logs but not metrics.

This change makes OWS consistent with datacube-explorer:
opendatacube/datacube-explorer@6051dd6
Copy link
Contributor

@SpacemanPaul SpacemanPaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep sure.

Copy link

codecov bot commented Dec 5, 2023

Codecov Report

Merging #978 (4704d26) into master (20717bb) will not change coverage.
Report is 1 commits behind head on master.
The diff coverage is 100.00%.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #978   +/-   ##
=======================================
  Coverage   93.71%   93.71%           
=======================================
  Files          43       43           
  Lines        6479     6479           
=======================================
  Hits         6072     6072           
  Misses        407      407           
Files Coverage Δ
datacube_ows/startup_utils.py 92.56% <100.00%> (ø)

Copy link
Member

@omad omad left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds like a good first cut! So much simpler than anything I was imagining!

@omad omad merged commit 637dd67 into master Dec 5, 2023
12 checks passed
@omad omad deleted the metrics-not-logs branch December 5, 2023 22:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants