Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inputs outputs wrapper #4298

Open
wants to merge 40 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
9a33305
Update k8s deps for flytepropeller
EngHabu Oct 10, 2023
638a8d1
wip
EngHabu Oct 10, 2023
f38bc63
Introduce InputData and OutputData wrappers
EngHabu Oct 11, 2023
115bed0
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Oct 11, 2023
d29fd05
wip
EngHabu Oct 12, 2023
b8c24f2
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Oct 12, 2023
c9aa26d
ignore bin dirs
EngHabu Oct 27, 2023
65998c4
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Dec 14, 2023
e6ad943
Use the right error type for parsing connection errors
EngHabu Dec 14, 2023
8961f19
wip
EngHabu Dec 15, 2023
57fa63d
regen
EngHabu Dec 15, 2023
d250dd2
wip
EngHabu Dec 29, 2023
77fae93
Update bindings to read the new format
EngHabu Dec 29, 2023
8b89496
Fixed unit tests and lint... I think
EngHabu Jan 6, 2024
d36c1e1
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 6, 2024
8497add
Fix arraynode
EngHabu Jan 6, 2024
8509f84
wip
EngHabu Jan 9, 2024
181cb0a
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 9, 2024
35419b6
lint
EngHabu Jan 9, 2024
99d0e10
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 11, 2024
624e57f
check for proto diff
EngHabu Jan 23, 2024
4965b1e
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 23, 2024
62e37cb
Lint
EngHabu Jan 23, 2024
4b59975
Try Tmate
EngHabu Jan 23, 2024
2f45a9f
just attach on prev failure
EngHabu Jan 23, 2024
bd4fc27
Add it to the right workflow
EngHabu Jan 23, 2024
0f33255
Default to not supported for unknown sdks/versions
EngHabu Jan 24, 2024
c36fa39
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 24, 2024
90bacf7
unit tests
EngHabu Jan 24, 2024
0721a7e
test
EngHabu Jan 24, 2024
4580a89
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 25, 2024
e95d7ae
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 25, 2024
af6e862
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jan 29, 2024
8fc6c33
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Feb 9, 2024
3273c5e
merge conflict
EngHabu Feb 9, 2024
5f083c8
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Feb 13, 2024
f250697
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jul 2, 2024
ede1297
Remaining merge conflicts
EngHabu Jul 3, 2024
76005db
Merge branch 'master' of github.com:flyteorg/flyte into inputs-output…
EngHabu Jul 4, 2024
ddc3fe0
Fix make generate and run it
EngHabu Jul 4, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions .github/workflows/single-binary.yml
Original file line number Diff line number Diff line change
Expand Up @@ -199,6 +199,12 @@ jobs:
- name: End2End
run: |
make end2end_execute
- name: Setup tmate session
uses: mxschmitt/action-tmate@v3
if: ${{ failure() }}
with:
limit-access-to-actor: true


build-and-push-sandbox-bundled-image:
if: ${{ github.event_name == 'push' || github.event_name == 'workflow_dispatch' }}
Expand Down
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,8 @@ dist
*.db
vendor/
/docker/sandbox-bundled/images/tar
rsts/_tags/
bin/
**/bin/
docs/_tags/
docs/flytectl
Expand Down
10 changes: 10 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
export REPOSITORY=flyte
export REPO_ROOT := $(shell pwd)
include boilerplate/flyte/end2end/Makefile
include boilerplate/flyte/golang_test_targets/Makefile

Expand Down Expand Up @@ -136,6 +137,15 @@ go-tidy:
make -C flytestdlib go-tidy
make -C flytecopilot go-tidy

.PHONY: generate
generate:
make -C flyteidl generate
make -C flyteadmin generate
make -C flytepropeller generate
make -C flyteplugins generate
make -C flytestdlib generate
make -C flytecopilot generate

.PHONY: lint-helm-charts
lint-helm-charts:
# This pressuposes that you have act installed
Expand Down
3 changes: 2 additions & 1 deletion boilerplate/flyte/golang_test_targets/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,11 @@
# TO OPT OUT OF UPDATES, SEE https://github.com/flyteorg/boilerplate/blob/master/Readme.rst

LINT_FLAGS ?=
export REPO_ROOT ?= $(shell pwd)

.PHONY: download_tooling
download_tooling: #download dependencies (including test deps) for the package
@../boilerplate/flyte/golang_test_targets/download_tooling.sh
@${REPO_ROOT}/boilerplate/flyte/golang_test_targets/download_tooling.sh

.PHONY: generate
generate: download_tooling #generate go code
Expand Down
2 changes: 1 addition & 1 deletion boilerplate/flyte/golang_test_targets/download_tooling.sh
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ cp $REPO_ROOT/flytestdlib/bin/pflags $(go env GOPATH)/bin

tmp_dir=$(mktemp -d -t gotooling-XXX)
echo "Using temp directory ${tmp_dir}"
cp -R ../boilerplate/flyte/golang_support_tools/* $tmp_dir
cp -R $REPO_ROOT/boilerplate/flyte/golang_support_tools/* $tmp_dir
pushd "$tmp_dir"

for tool in "${tools[@]}"; do
Expand Down
61 changes: 61 additions & 0 deletions cmd/single/config_flags.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

200 changes: 200 additions & 0 deletions cmd/single/config_flags_test.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 0 additions & 1 deletion cmd/single/without_console_dist.go
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
//go:build !console
// +build !console

package single

Expand Down
2 changes: 1 addition & 1 deletion datacatalog/Makefile
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
export REPOSITORY=datacatalog
export REPO_ROOT=..
export REPO_ROOT ?= $(shell pwd)/../
include ../boilerplate/flyte/docker_build/Makefile
include ../boilerplate/flyte/golang_test_targets/Makefile

Expand Down
2 changes: 1 addition & 1 deletion flyteadmin/Makefile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
export REPOSITORY=flyteadmin
export FLYTE_SCHEDULER_REPOSITORY=flytescheduler
export REPO_ROOT=..
export REPO_ROOT ?= $(shell pwd)/../
include ../boilerplate/flyte/docker_build/Makefile
include ../boilerplate/flyte/golang_test_targets/Makefile
include ../boilerplate/flyte/end2end/Makefile
Expand Down
Loading
Loading