Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extracting PM metrics on Kafka Cluster results in duplicate files due to different cases in the same metric names. #980

Closed
secureaniruddha opened this issue Jun 21, 2024 · 5 comments

Comments

@secureaniruddha
Copy link

One of our customers is trying to extract PM metrics logs and has encountered duplicate files due to different cases with the same metrics names. This means one file contains metrics entries in uppercase and another in lowercase. They want to know if all java_lang related PM metrics entries can be configured in lowercase to avoid file duplication.

Is it possible to configure all java_lang related metrics entries in lowercase, and is it recommended?

metrics. zip

@secureaniruddha secureaniruddha changed the title Extracting PM metrics results in duplicate files due to different cases in the same metric names. Extracting PM metrics on Kafka Cluster results in duplicate files due to different cases in the same metric names. Jun 21, 2024
@dhoard
Copy link
Collaborator

dhoard commented Jun 21, 2024

@secureaniruddha you can use lowercaseOutputName: true to make all metric names lowercase, but there is no per-metric configuration.

@secureaniruddha
Copy link
Author

secureaniruddha commented Jun 21, 2024

Hi @dhoard Thanks for the swift reply. If there is no option for per metric configuration, is there any way which ensure there should be a single file in any case to avoid duplication?

@dhoard
Copy link
Collaborator

dhoard commented Jun 21, 2024

@secureaniruddha there is no per-metric configuration to convert the metric name to lowercase. Typically lowercaseOutputName: true is used for metric name consistency.

Can you elaborate on what you mean by "file duplication"?

@secureaniruddha
Copy link
Author

secureaniruddha commented Jun 24, 2024

@dhoard After upgrading files can be generated ok, but extracting pm metrics files has duplicated files in windows. The duplicated files' content are different, and file names differences are: capital letters and lowercase.
On linux this leads to an inconsistency because different case filenames are treated as different files (it still is an issue of different contents and writing to different places). On Windows it's more pressing issue, since same name different case files overwrite one another, and the metrics data is essentially lost.

@dhoard
Copy link
Collaborator

dhoard commented Jun 24, 2024

@secureaniruddha This sounds like an issue with the CCRC tool, since the exporter only exposed metrics via HTTP(S).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants