Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a Prometheus Remote-Write input plugin #7526

Closed
stevehipwell opened this issue Jun 7, 2023 · 10 comments
Closed

Add a Prometheus Remote-Write input plugin #7526

stevehipwell opened this issue Jun 7, 2023 · 10 comments
Labels

Comments

@stevehipwell
Copy link

Is your feature request related to a problem? Please describe.
When running Fluent Bit as an OTEL aggregator (multiple replicas) and wanting to aggregate metrics from Prometheus there isn't currently a way to do this without duplicating the metrics across all of the replicas. This is because Prometheus can't currently push metrics in OTEL format.

Describe the solution you'd like
I'd like Fluent Bit to support the Prometheus Remote-Write specification so prometheus can push metrics to a Fluent Bit Aggregator service without duplicating the metrics.

Describe alternatives you've considered
Not aggregating metrics and pushing straight from Prometheus, but this isn't as reliable or consistent.

Additional context

@agup006
Copy link
Member

agup006 commented Jun 30, 2023

Ah I like this I assume HTTP/2 input is needed @leonardo-albertovich as FYI

@stevehipwell
Copy link
Author

Based on the spec I think HTTP/1.1 is valid.

@leonardo-albertovich
Copy link
Collaborator

Yes, HTTP/1.1 should be good enough, there are no blockers as far as I know.

Copy link
Contributor

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

@github-actions github-actions bot added the Stale label Dec 10, 2023
@stevehipwell
Copy link
Author

/not-stale

@github-actions github-actions bot removed the Stale label Dec 14, 2023
Copy link
Contributor

github-actions bot commented Apr 7, 2024

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

@github-actions github-actions bot added the Stale label Apr 7, 2024
@stevehipwell
Copy link
Author

/not-stale

@github-actions github-actions bot removed the Stale label Apr 9, 2024
@stevehipwell
Copy link
Author

I assume that #8725 is related or potentially delivers this functionality?

Copy link
Contributor

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

@github-actions github-actions bot added the Stale label Aug 16, 2024
@stevehipwell
Copy link
Author

It looks like the Prometheus Remote Write functionality has been delivered so I'll close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants