Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(child pipeline executions): Add support for omit other stages fr… #4303

Closed

Conversation

Avi1235
Copy link

@Avi1235 Avi1235 commented Sep 28, 2022

This PR introduces a feature flag isolatedStreamExecution that can be defined in Run Pipeline stage. You can enable it via stage or in orca config stages.pipeline.defaultIsolatedStreamExecution by enabling it, clears all the info that other stages ran on the parent pipeline in the child - trigger.parentExecution values.

PR's related: 3989 4080

issue related 6159

For testing i ran the next pipeline: pipeline stage(trigger son-1) -> manual judgment -> pipeline stage(trigger son-2) -> manual judgment -> pipeline stage(trigger son-3)
The childs(son 1/2/3): only had a wait stage

the body of the last pipeline stage increments due to keeping track of the stages that ran before and created outputs, task etc.
Screen Shot 2022-09-27 at 8 55 44 AM

tests after enabling isolatedStreamExecution: true
Screen Shot 2022-09-27 at 8 59 14 AM

@vjda
Copy link
Contributor

vjda commented Sep 14, 2023

We face some issues about huge contexts in our pipeline executions and this would be a BIG step forward to address it. Is there any ETA planned to merge this into the code base? 🙏🏻

@Avi1235
Copy link
Author

Avi1235 commented Oct 20, 2023

Maybe ask in spinnaker slack channel, there shouldnt be any problem merging this as it can be tuner on and off with the flag

@jasonmcintosh
Copy link
Member

Really needed some tests for this ;) I like the idea, and it's similar to the skip downstream flag, though operates differently from what I can see.

@Avi1235 Avi1235 force-pushed the isolated-pipeline-stageExecutions branch 2 times, most recently from 5b1a31f to c3de354 Compare December 21, 2023 02:06
@Avi1235 Avi1235 force-pushed the isolated-pipeline-stageExecutions branch from 7aec873 to 7902999 Compare December 21, 2023 17:04
@Avi1235
Copy link
Author

Avi1235 commented Dec 21, 2023

Ran the workflows please 🙏 , i added a test which proves the child pipeline is isolated only having record of one stage from his parentExecution

@Avi1235
Copy link
Author

Avi1235 commented Jun 4, 2024

Closing since #4620 i believe addresses huge pipelines bodies

@Avi1235 Avi1235 closed this Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants