Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve logging experience #26

Open
jferris opened this issue Aug 6, 2021 · 1 comment
Open

Improve logging experience #26

jferris opened this issue Aug 6, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@jferris
Copy link
Contributor

jferris commented Aug 6, 2021

We deploy Fluent Bit and we're sending logs to Cloudwatch in the AWS platform. Cloudwatch is hard to search and expensive for data retention. It's also only viewable from workload accounts.
@jferris jferris added the enhancement New feature or request label Aug 6, 2021
@jferris
Copy link
Contributor Author

jferris commented Sep 7, 2021

We may be able to improve the experience with Cloudwatch:

  • Searching via Insights is much easier. We can use structured logs and pre-configured Insights queries to simplify this.
  • It's not actually data retention that's expensive, but data ingestion. Reducing the default logging volume helps with this.
  • We can either send logs to a centralized monitoring account or enable cross-account access.

@jferris jferris changed the title Logging stack v2 Improve logging experience Jan 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jferris