Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Parallelize Node Evaluations #590

Closed
wants to merge 1 commit into from

Conversation

hamersaw
Copy link
Contributor

TL;DR

This PR parallelizes node evaluations by using go channels to call the handleNode function in a separate go routine and then waiting on all evaluations before compiling overall workflow status.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

^^^

Tracking Issue

fixes flyteorg/flyte#3866

Follow-up issue

NA

@eapolinario
Copy link
Contributor

Hi, we are moving all Flyte development to a monorepo. In order to help the transition period, we're moving open PRs to monorepo automatically and your PR was moved to flyteorg/flyte#4155. Notice that if there are any conflicts in the resulting PR they most likely happen due to the change in the import path of the flyte components.

@eapolinario eapolinario closed this Oct 3, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Core feature] Parallelize Node Executions in FlytePropeller
2 participants