Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[YUNIKORN-2907] Queue config processing log spew #1009

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

kousei47747
Copy link

What is this PR for?

Logs the shadow queue structure created during configuration update at debug level with a different message to prevent log spew and avoid misleading information.

What type of PR is it?

  • - Bug Fix
  • - Improvement
  • - Feature
  • - Documentation
  • - Hot Fix
  • - Refactoring

What is the Jira issue?

https://issues.apache.org/jira/browse/YUNIKORN-2907

Copy link

codecov bot commented Dec 28, 2024

Codecov Report

Attention: Patch coverage is 40.35088% with 34 lines in your changes missing coverage. Please review.

Project coverage is 82.20%. Comparing base (a351764) to head (7476680).
Report is 2 commits behind head on master.

Files with missing lines Patch % Lines
pkg/scheduler/partition.go 31.11% 31 Missing ⚠️
pkg/scheduler/objects/queue.go 81.81% 2 Missing ⚠️
pkg/scheduler/context.go 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1009      +/-   ##
==========================================
- Coverage   82.34%   82.20%   -0.14%     
==========================================
  Files          97       97              
  Lines       15627    15674      +47     
==========================================
+ Hits        12868    12885      +17     
- Misses       2479     2510      +31     
+ Partials      280      279       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kousei47747 thanks for this patch. There is one small question remaining. Please take a look.

pkg/scheduler/partition.go Outdated Show resolved Hide resolved
return queue, err
}

// NewConfiguredShadowQueue creates a new queue from scratch based on the configuration and logs at debug level
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @kousei47747, thank you for your contribution!

Could you provide more details about the differences between NewConfiguredQueue and NewConfiguredShadowQueue?
Currently, it appears the only difference is the log level, which may be confusing for those unfamiliar with shadow queues.

It would be helpful to explain when developers should use NewConfiguredQueue versus NewConfiguredShadowQueue.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@blueBlue0102 thanks for reviewing! I will provide more detailed description in the new patch.

@kousei47747 kousei47747 marked this pull request as draft December 29, 2024 08:27
@wilfred-s
Copy link
Contributor

I dropped a large comment into the jira to provide some guidance and point out another issue.

@kousei47747
Copy link
Author

@wilfred-s thanks for reviewing! I've replied on jira, please take a look.

@kousei47747
Copy link
Author

I’ve updated the PR based on the guidance and noticed that NewPlacementManager also logs. Should it be silenced too?

@kousei47747 kousei47747 marked this pull request as ready for review January 2, 2025 07:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants