Skip to content

πŸͺ½ Flyte workflow configuration with hydra-zen πŸ‰ 🧘

License

Notifications You must be signed in to change notification settings

sciexp/flytezen

Folders and files

NameName
Last commit message
Last commit date

Latest commit

6f0a9e7 Β· Dec 30, 2023
Dec 16, 2023
Dec 18, 2023
Dec 16, 2023
Dec 30, 2023
Dec 18, 2023
Dec 27, 2023
Dec 29, 2023
Dec 27, 2023
Dec 19, 2023
Dec 27, 2023
Nov 25, 2023
Nov 25, 2023
Dec 19, 2023
Dec 16, 2023
Dec 16, 2023
Dec 30, 2023
Nov 25, 2023
Dec 30, 2023
Dec 29, 2023
Dec 19, 2023
Dec 22, 2023
Dec 30, 2023
Dec 29, 2023
Dec 27, 2023
Dec 16, 2023
Dec 30, 2023
Dec 27, 2023

flytezen

A template for hydra-zen configuration of Flyte workflow execution.

Quick start

See make | grep codespace, run make codespace_create code, or

codespaces

This provides a zero install demonstration of the supported development environment that depends on the nix package manager or open container images built with it. See make | grep nix or make -n setup_dev to setup a local copy of this environment.

Layout

tree
.
β”œβ”€β”€ .argo
β”‚   └── build.yaml
β”œβ”€β”€ .devcontainer
β”‚   β”œβ”€β”€ devcontainer.Dockerfile
β”‚   └── devcontainer.json
β”œβ”€β”€ .flyte
β”‚   β”œβ”€β”€ config-browser.yaml
β”‚   β”œβ”€β”€ config-local.yaml
β”‚   β”œβ”€β”€ config-template.yaml
β”‚   └── config.yaml
β”œβ”€β”€ .github
β”‚   β”œβ”€β”€ actions
β”‚   β”‚   β”œβ”€β”€ setup_environment
β”‚   β”‚   β”‚   └── action.yml
β”‚   β”‚   └── tag-build-push-container
β”‚   β”œβ”€β”€ disabled
β”‚   β”‚   β”œβ”€β”€ CD.yaml
β”‚   β”‚   └── CI.yaml
β”‚   β”œβ”€β”€ workflows
β”‚   β”‚   β”œβ”€β”€ CID.yaml
β”‚   β”‚   β”œβ”€β”€ build-images.yaml
β”‚   β”‚   └── labeler.yml
β”‚   β”œβ”€β”€ .gitkeep
β”‚   β”œβ”€β”€ CODEOWNERS
β”‚   β”œβ”€β”€ codecov.yml
β”‚   β”œβ”€β”€ labels.yml
β”‚   └── renovate.json
β”œβ”€β”€ .vscode
β”‚   β”œβ”€β”€ extensions.json
β”‚   β”œβ”€β”€ launch.json
β”‚   β”œβ”€β”€ settings.json
β”‚   └── tasks.json
β”œβ”€β”€ containers
β”‚   β”œβ”€β”€ Dockerfile
β”‚   β”œβ”€β”€ compose.yaml
β”‚   β”œβ”€β”€ gpu.Dockerfile
β”‚   └── pkg.Dockerfile
β”œβ”€β”€ docs
β”‚   β”œβ”€β”€ notebooks
β”‚   β”‚   └── text
β”‚   β”œβ”€β”€ reference
β”‚   β”‚   └── flytezen.md
β”‚   β”œβ”€β”€ index.md
β”‚   └── specification.md
β”œβ”€β”€ environments
β”‚   └── conda
β”‚       β”œβ”€β”€ conda-linux-64.lock.yml
β”‚       β”œβ”€β”€ conda-lock.yml
β”‚       └── virtual-packages.yml
β”œβ”€β”€ src
β”‚   β”œβ”€β”€ flytezen
β”‚   β”‚   β”œβ”€β”€ cli
β”‚   β”‚   β”‚   β”œβ”€β”€ __init__.py
β”‚   β”‚   β”‚   β”œβ”€β”€ execute.py
β”‚   β”‚   β”‚   β”œβ”€β”€ execution_config.py
β”‚   β”‚   β”‚   └── execution_utils.py
β”‚   β”‚   β”œβ”€β”€ workflows
β”‚   β”‚   β”‚   β”œβ”€β”€ __init__.py
β”‚   β”‚   β”‚   β”œβ”€β”€ example.py
β”‚   β”‚   β”‚   └── lrwine.py
β”‚   β”‚   β”œβ”€β”€ __init__.py
β”‚   β”‚   β”œβ”€β”€ __main__.py
β”‚   β”‚   β”œβ”€β”€ configuration.py
β”‚   β”‚   β”œβ”€β”€ constants.py
β”‚   β”‚   └── logging.py
β”‚   └── .gitkeep
β”œβ”€β”€ tests
β”‚   β”œβ”€β”€ __init__.py
β”‚   β”œβ”€β”€ conftest.py
β”‚   └── test_cli.py
β”œβ”€β”€ .dockerignore
β”œβ”€β”€ .env
β”œβ”€β”€ .envrc
β”œβ”€β”€ .example.env
β”œβ”€β”€ .gitignore
β”œβ”€β”€ CHANGELOG.md
β”œβ”€β”€ LICENSE
β”œβ”€β”€ Makefile
β”œβ”€β”€ README.md
β”œβ”€β”€ devshell
β”œβ”€β”€ flake.lock
β”œβ”€β”€ flake.nix
β”œβ”€β”€ mkdocs.yml
β”œβ”€β”€ poetry.lock
β”œβ”€β”€ poetry.toml
β”œβ”€β”€ pyproject.toml
└── requirements.txt

23 directories, 65 files

Acknowledgements

Selected dependencies

See also flake.nix, pyproject.toml, and .github.