Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't send inputURI for start-node #5780

Closed
wants to merge 1 commit into from

Conversation

iaroslav-ciupin
Copy link
Contributor

Tracking issue

Why are the changes needed?

send empty inputUri for start-node in node execution event to flyteadmin and therefore, GetNodeExecutionData will not attempt to download non-existing inputUri as it was doing before this change.
add DB migration to clear input_uri in existing node_executions table for start nodes.

What changes were proposed in this pull request?

How was this patch tested?

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

@iaroslav-ciupin iaroslav-ciupin changed the title Union/upstream 6a7207c53 Don't send inputURI for start-node Sep 26, 2024
@iaroslav-ciupin iaroslav-ciupin changed the base branch from master to union/upstream September 26, 2024 19:38
Copy link

codecov bot commented Sep 26, 2024

Codecov Report

Attention: Patch coverage is 76.00000% with 6 lines in your changes missing coverage. Please review.

Project coverage is 36.46%. Comparing base (0d1583e) to head (a0ba30b).

Files with missing lines Patch % Lines
flyteadmin/pkg/repositories/config/migrations.go 0.00% 6 Missing ⚠️
Additional details and impacted files
@@                Coverage Diff                 @@
##           union/upstream    #5780      +/-   ##
==================================================
- Coverage           36.46%   36.46%   -0.01%     
==================================================
  Files                1309     1309              
  Lines              110464   110458       -6     
==================================================
- Hits                40284    40281       -3     
+ Misses              66011    66008       -3     
  Partials             4169     4169              
Flag Coverage Δ
unittests-datacatalog 51.37% <ø> (ø)
unittests-flyteadmin 55.83% <0.00%> (+0.01%) ⬆️
unittests-flytecopilot 12.17% <ø> (ø)
unittests-flytectl 62.21% <ø> (ø)
unittests-flyteidl 7.16% <ø> (ø)
unittests-flyteplugins 53.32% <ø> (ø)
unittests-flytepropeller 42.04% <100.00%> (+0.01%) ⬆️
unittests-flytestdlib 55.84% <ø> (-0.13%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

* send empty `inputUri` for `start-node` in node execution event to flyteadmin and therefore, GetNodeExecutionData will not attempt to download non-existing inputUri as it was doing before this change.
* add DB migration to clear `input_uri` in existing `node_executions` table for start nodes.

*TODO: Summarize tests added, integration tests run, or other steps you took to validate this change. Include (or link to) relevant test output or screenshots.*

*TODO: Describe any deployment or compatibility considerations for rolling out this change.*

Should this change be upstreamed to OSS (flyteorg/flyte)? If not, please uncheck this box, which is used for auditing. Note, it is the responsibility of each developer to actually upstream their changes. See [this guide](https://unionai.atlassian.net/wiki/spaces/ENG/pages/447610883/Flyte+-+Union+Cloud+Development+Runbook/#When-are-versions-updated%3F).
- [x] To be upstreamed to OSS

* fixes COR-1134 by sending empty `inputUri` in node execution event to flyteadmin and therefore, `GetNodeExecutionData` will not attempt to download non-existing `inputUri` as it was doing before this change.

* [ ] Added tests
* [ ] Ran a deploy dry run and shared the terraform plan
* [ ] Added logging and metrics
* [ ] Updated [dashboards](https://unionai.grafana.net/dashboards) and [alerts](https://unionai.grafana.net/alerting/list)
* [ ] Updated documentation

Signed-off-by: Iaroslav Ciupin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants