Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CDAP-21096] Remove in-memory launching queue from RunRecordMonitorService #15800

Merged

Conversation

vsethi09
Copy link
Contributor

@vsethi09 vsethi09 commented Jan 13, 2025

Context

Multiple instances of RunRecordMonitoringService cannot run as distributed services as the in-memory cache of the launching queue will result in inconsistencies.

Removed the in-memory launching queue from the RunRecordMonitoringService and used AppMetadataStore APIs.

For more context, see: #15773 (comment).

Note: RunRecordMonitoringService is renamed as FlowControlMonitoringService.

Testing

  • Unit Tests
  • CDAP sandbox
  • Docker image

@vsethi09 vsethi09 added the build Triggers github actions build label Jan 13, 2025
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch 5 times, most recently from dc068c3 to 0ea30c6 Compare January 15, 2025 20:37
@vsethi09 vsethi09 changed the title [WIP] Remove in-memory launching queue in RunRecordMonitorService [CDAP-21096] Remove in-memory launching queue from RunRecordMonitorService Jan 15, 2025
@vsethi09 vsethi09 marked this pull request as ready for review January 15, 2025 20:42
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch from 0ea30c6 to abcd4c5 Compare January 15, 2025 20:49
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch 2 times, most recently from 343101b to db8a3ab Compare January 17, 2025 15:24
@vsethi09 vsethi09 requested a review from tivv January 17, 2025 15:26
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch from db8a3ab to 66da732 Compare January 17, 2025 16:07
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch 3 times, most recently from ea09155 to d9e4c13 Compare January 20, 2025 16:35
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch from d9e4c13 to 31c5b1c Compare January 22, 2025 10:32
Copy link
Contributor

@tivv tivv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a small comment

@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch from 31c5b1c to 0e1ba0b Compare January 23, 2025 06:33
@vsethi09 vsethi09 force-pushed the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch from 0e1ba0b to 03216d0 Compare January 24, 2025 12:46
Copy link

Quality Gate Failed Quality Gate failed

Failed conditions
C Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@vsethi09 vsethi09 merged commit b85f031 into develop Jan 24, 2025
11 of 12 checks passed
@vsethi09 vsethi09 deleted the feature/CDAP-21096_fix_RunRecordMonitorService_queue_cache branch January 24, 2025 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Triggers github actions build
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants