Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create MSK Serverless scrape config #609

Merged
merged 1 commit into from
Dec 10, 2024

Conversation

brituck
Copy link
Contributor

@brituck brituck commented Dec 10, 2024

InfraAPI is using AWS MSK Serverless for event streaming. Adds MSK serverless metrics config for atlas. See https://docs.aws.amazon.com/msk/latest/developerguide/serverless-monitoring.html for metrics details.

Copy link
Contributor

@manolama manolama left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dimensions = [
"Cluster Name",
"Topic",
"Consumer Group"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll need to keep an eye on cardinality here if there will be multiple groups for a large # of topics.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, add these three to the tag map in https://github.com/Netflix-Skunkworks/iep-apps/blob/main/atlas-cloudwatch/src/main/resources/reference.conf#L236 with dotted notation for Atlas please.

]
}

msk-serverless-consumergroup = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cloudwatch {

// https://docs.aws.amazon.com/msk/latest/developerguide/serverless-monitoring.html
msk-serverless-cluster = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@manolama manolama merged commit 68e5f27 into Netflix-Skunkworks:main Dec 10, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants