diff --git a/CHANGELOG/CHANGELOG-v1.10.0.md b/CHANGELOG/CHANGELOG-v1.10.0.md new file mode 100644 index 0000000000..42c301ac2e --- /dev/null +++ b/CHANGELOG/CHANGELOG-v1.10.0.md @@ -0,0 +1,174 @@ +# Flyte v1.10.0 Release + +This release marks the move to the (monorepo](https://github.com/flyteorg/flyte/pull/4014). From now on the development of backend components is going to be done in the Flyte [main repo](https://github.com/flyteorg/flyte/). + +Flyte Agents are also getting a major lift. They are not only more performant, but we're also announcing support for a variety of agents, including [Airflow](https://github.com/flyteorg/flytekit/pull/1725), [Memverge](https://github.com/flyteorg/flytekit/pull/1821), [Snowflake](https://github.com/flyteorg/flytekit/pull/1799), [Databricks](https://github.com/flyteorg/flytekit/pull/1797). + +Programmatically consuming inputs and outputs using flyteremote became a lot easier with the introduction of code snippets directly in the UI. For example, notice the small blurbs below inputs and outputs in the side panel: + +![Usage snippet](./images/v1.10.0-flyteconsole-programmatic-access.png) + +You'll now be able to use offloaded types in [eager workflows](https://docs.flyte.org/projects/cookbook/en/latest/auto_examples/advanced_composition/eager_workflows.html#id1). + +More ergonomic improvements to [pyflyte](https://docs.flyte.org/projects/flytekit/en/latest/pyflyte.html#pyflyte-cli), including the inclusion of a progress bar, the ability to activate launchplans, and the ability to interact with gate nodes in local executions. + +And much more. Here's the exhaustive list of changes: + +### Flytekit +* Better error messaging for overrides by @kumare3 in https://github.com/flyteorg/flytekit/pull/1807 +* Run remote Launchplan from `pyflyte run` by @kumare3 in https://github.com/flyteorg/flytekit/pull/1785 +* Add is none function by @pingsutw in https://github.com/flyteorg/flytekit/pull/1757 +* Dynamic workflow should not throw nested task warning by @oliverhu in https://github.com/flyteorg/flytekit/pull/1812 +* Add a manual image building GH action by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1816 +* Enable Azure Workload Identity for `fsspec` in `flytekit` by @fiedlerNr9 in https://github.com/flyteorg/flytekit/pull/1813 +* Fix list of annotated structured dataset by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1817 +* Support the flytectl config.yaml admin.clientSecretEnvVar option in flytekit by @chaohengstudent in https://github.com/flyteorg/flytekit/pull/1819 +* Async agent delete function for while loop case by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1802 +* fix docs warnings by @samhita-alla in https://github.com/flyteorg/flytekit/pull/1827 +* Fix extract_task_module by @pingsutw in https://github.com/flyteorg/flytekit/pull/1829 +* Feat: Add type support for pydantic BaseModels by @ArthurBook in https://github.com/flyteorg/flytekit/pull/1660 +* Make FlyteRemote example slightly more copy/pastable by @katrogan in https://github.com/flyteorg/flytekit/pull/1830 +* Pyflyte meta inputs by @kumare3 in https://github.com/flyteorg/flytekit/pull/1823 +* Use mashumaro to serialize/deserialize dataclass by @hhcs9527 in https://github.com/flyteorg/flytekit/pull/1735 +* Databricks Agent by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1797 +* Prometheus metrics by @pingsutw in https://github.com/flyteorg/flytekit/pull/1815 +* Pyflyte register optionally activates schedule by @kumare3 in https://github.com/flyteorg/flytekit/pull/1832 +* Remove versions 3.9 and 3.10 by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1831 +* Snowflake agent by @hhcs9527 in https://github.com/flyteorg/flytekit/pull/1799 +* Update agent metric name by @pingsutw in https://github.com/flyteorg/flytekit/pull/1835 +* MemVerge MMCloud Agent by @edwinyyyu in https://github.com/flyteorg/flytekit/pull/1821 +* Add download badges to the readme by @pingsutw in https://github.com/flyteorg/flytekit/pull/1836 +* Eager local entrypoint and support for offloaded types by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1833 +* update requirements and add snowflake agent to api reference by @samhita-alla in https://github.com/flyteorg/flytekit/pull/1838 +* Fix: Make sure decks created in elastic task workers are transferred to parent process by @fg91 in https://github.com/flyteorg/flytekit/pull/1837 +* add accept grpc by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1841 +* Feat: Enable `flytekit` to authenticate with proxy in front of FlyteAdmin by @fg91 in https://github.com/flyteorg/flytekit/pull/1787 +* Backfill command now supports failure-policy by @kumare3 in https://github.com/flyteorg/flytekit/pull/1840 +* Pass cluster pool when creating executions by @iaroslav-ciupin in https://github.com/flyteorg/flytekit/pull/1208 +* Add more clear error message when fetching secrets by @ysysys3074 in https://github.com/flyteorg/flytekit/pull/1847 +* Pyflyte run workflows correctly handles Optional[TYPE] = None by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1849 +* Bump gitpython from 3.1.32 to 3.1.35 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in https://github.com/flyteorg/flytekit/pull/1828 +* Bump cryptography from 41.0.3 to 41.0.4 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in https://github.com/flyteorg/flytekit/pull/1844 +* update codecov config in pythonbuild ci by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1852 +* Improved gate node handling by @kumare3 in https://github.com/flyteorg/flytekit/pull/1850 +* update codecov yaml, make eager wf test more stable by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1854 +* more codecov updates by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1856 +* make mlflow plugin work with python 3.11 by @bcvanmeurs in https://github.com/flyteorg/flytekit/pull/1855 +* Agent get secret function by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1851 +* Better Azure blob storage support by @Tom-Newton in https://github.com/flyteorg/flytekit/pull/1842 +* Remove Envd from dockerfile by @pingsutw in https://github.com/flyteorg/flytekit/pull/1814 +* Update agent uri format by @hhcs9527 in https://github.com/flyteorg/flytekit/pull/1861 +* modified setup.py in flytekit-mmcloud by @helenzhangyc in https://github.com/flyteorg/flytekit/pull/1864 +* Label request_failure metric with error_code by @pingsutw in https://github.com/flyteorg/flytekit/pull/1862 +* add back Edwin's name by @helenzhangyc in https://github.com/flyteorg/flytekit/pull/1868 +* Fix py38 aync agent service and add async agent test by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1866 +* Pin because not installing by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1872 +* Bump pillow from 10.0.0 to 10.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in https://github.com/flyteorg/flytekit/pull/1867 +* Prune hosted github runner to free up space for sandbox by @jeevb in https://github.com/flyteorg/flytekit/pull/1875 +* Fixes Auth issue, where refresh token is expired by @kumare3 in https://github.com/flyteorg/flytekit/pull/1873 +* Name field is incorrect assigned by @kumare3 in https://github.com/flyteorg/flytekit/pull/1874 +* [Docs]Updated examples for customizing resources by @LunarMarathon in https://github.com/flyteorg/flytekit/pull/1871 +* change key path to SNOWFLAKE_PRIVATE_KEY by @hhcs9527 in https://github.com/flyteorg/flytekit/pull/1879 +* Run notebook task on aws batch by @pingsutw in https://github.com/flyteorg/flytekit/pull/1859 +* Automatically Convert `name` Argument and `registry` Argument to Lowercase in ImageSpec by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1881 +* Dep: Pin min required flytekit version in IAP plugin by @fg91 in https://github.com/flyteorg/flytekit/pull/1878 +* Remove duplicate click option by @wild-endeavor in https://github.com/flyteorg/flytekit/pull/1883 +* Bump urllib3 from 1.26.16 to 1.26.17 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in https://github.com/flyteorg/flytekit/pull/1865 +* Improve error message in ListTransformer when not passing a list by @fg91 in https://github.com/flyteorg/flytekit/pull/1882 +* Update `typing_extension` Any import to typing due to `typing_extension` version compatibility by @hfurkanvural in https://github.com/flyteorg/flytekit/pull/1877 +* Bump gitpython from 3.1.35 to 3.1.37 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in https://github.com/flyteorg/flytekit/pull/1885 +* Airflow agent by @pingsutw in https://github.com/flyteorg/flytekit/pull/1725 +* Add mmcloud plugin into the agent image by @pingsutw in https://github.com/flyteorg/flytekit/pull/1891 +* Fix map_task sensitive to argument order by @chaohengstudent in https://github.com/flyteorg/flytekit/pull/1888 +* Add enable_deck to task decorator by @eapolinario in https://github.com/flyteorg/flytekit/pull/1898 +* Add image transformer by @pingsutw in https://github.com/flyteorg/flytekit/pull/1901 +* add default project domain in execute launch plan by @troychiu in https://github.com/flyteorg/flytekit/pull/1894 +* Add Databricks and Snowflake agent to Dockerfile by @Future-Outlier in https://github.com/flyteorg/flytekit/pull/1905 +* Fix module loading bug in instance tracker class by @cosmicBboy in https://github.com/flyteorg/flytekit/pull/1902 + +### Flyteadmin +* Fixed bug for incorrect name (#4175) +* Add version control for ArrayNode eventing (#4165) +* Update golang experimental dep (#4177) +* Add Additional gRPC service handler hook (#4171) +* Handle batched TaskExecutionEvent reasons (#615) +* Lint flyteadmin/auth/handlers_test.go +* #patch Update FromWorkflowModel API (#617) +* add codespell: config, workflow and have typos fixed (#4054) +* Handle batched TaskExecutionEvent reasons (#615) +* Update FromWorkflowModel API (#617) +* Update boilerplate version (#605) +* Reduce a warning to info (#612) +* Logout hook plugin (#611) +* Expire flyte_idt cookie at logout (#610) +* Use configured domain on expired cookies (#608) +* Fix list named entities (#609) +* Merge pull request from GHSA-r847-6w6h-r8g4 +* Update boilerplate version (#604) +* Handle grpc error explicitly (#602) +* Introduce pre redirect hook plugin during auth callback (#601) +* Add default cluster pool assignments to config (#600) +* Implement Sandbox notifications processor and publisher (#595) + +### Flytepropeller +* [Extended Resources] GPU Accelerators (#4172) +* [Monorepo] Enable proxy-authorization in admin client (#4189) +* (monorepo--importing-flyteidl-452) Add version control for ArrayNode eventing (#4165) +* Update golang experimental dep (#4177) +* Moving from flytepropeller - Adding flags for ignore-retry-cause and default-max-attempts (#4153) +* [Monorepo] Rename flyteidl (#4166) +* Revert add supported task types for agent service by default for task types (#4162) +* reverting to parallelism increases only on non-terminal phase updates (#624) +* Add k8s events to task phase updates (#600) +* Ray log links (#620) +* Add supportTaskTypes for agentservice without write it in config twice. (#612) +* Bump flytestdlib version (#619) +* added check for invalid argument code on node event recording failure (#613) +* start informerFactory by default. (#614) +* bumped flyteplugins to v1.1.23 (#616) +* fixing boilerplate (#617) +* Supporting using arraynode as a subnode (#606) +* fixing max parallelism (#611) +* adding controller-runtime manager metrics handler to http endpoint (#607) +* pulled latest boilerplate (#609) +* Move caching to node executor for fast cache hits (#485) + +### Flyteplugins +* Update the item only if it exists in the cache (#4117) +* [Extended Resources] GPU Accelerators (#4172) +* Implement Spark pod template overrides (#4183) +* Support Evaluator in Kubeflow TensorFlow Training Operator (#4168) +* Agent Get Pending Message (#4106) +* Moving from flytepropeller - Adding flags for ignore-retry-cause and default-max-attempts (#4153) +* change to tf job worker spec (#4169) +* Return ResourceWrapper without pointer (#4115) +* Revert add supported task types for agent service by default for task types (#4162) +* Plugin changes for plumbing k8s events into TaskExecutionEvent (#406) +* Fix flyteplugins lint errors +* add codespell: config, workflow and have typos fixed (#4054) +* Add supportTaskTypes for agentservice without write it in config twice. (#398) +* Create a FileOutput reader if the agent produce file output (#391) +* Bump flytestdlib version (#404) +* feat: Dask add pod template support (#374) +* Mark webapi task failure as retry limit exceeded (#392) +* Make rendering template in agent client temporary (#395) +* enable secrets in non-python k8s tasks (#401) +* Rename agent chart (#4019) +* Fix resources requests for AWS Batch plugin (#400) +* Transition to Queue if the JobCondition is empty (#387) +* Fix databricks plugin test Naming Error (#393) +* Updating boilerplate to lock golangci-lint version (#394) +* Fix double http in the Spark Driver UI Link (#389) +* Render task template in the agent client (#384) + +### Flyteconsole +* show correct details panel io (#820) +* resume form should support all known types (#819) +* optional list arg is causing ui launch form to white screen (#817) +* breadcrumb dropdown render (#815) +* switching projects doesn't respect domain value (#814) +* invalid item in dropdown (#809) +* flyte decks height (#813) + +### datacatalog +* b5a958f Refactoring profile handler into entrypoints (#113) diff --git a/CHANGELOG/images/v1.10.0-flyteconsole-programmatic-access.png b/CHANGELOG/images/v1.10.0-flyteconsole-programmatic-access.png new file mode 100644 index 0000000000..5971414df7 Binary files /dev/null and b/CHANGELOG/images/v1.10.0-flyteconsole-programmatic-access.png differ diff --git a/charts/flyte-binary/README.md b/charts/flyte-binary/README.md index d6d9a3bb6a..af90288ab7 100644 --- a/charts/flyte-binary/README.md +++ b/charts/flyte-binary/README.md @@ -42,7 +42,7 @@ Chart for basic single Flyte executable deployment | configuration.auth.oidc.clientId | string | `""` | | | configuration.auth.oidc.clientSecret | string | `""` | | | configuration.co-pilot.image.repository | string | `"cr.flyte.org/flyteorg/flytecopilot"` | | -| configuration.co-pilot.image.tag | string | `"v1.9.4"` | | +| configuration.co-pilot.image.tag | string | `"v1.9.37"` | | | configuration.database.dbname | string | `"flyte"` | | | configuration.database.host | string | `"127.0.0.1"` | | | configuration.database.options | string | `"sslmode=disable"` | | diff --git a/charts/flyte-binary/values.yaml b/charts/flyte-binary/values.yaml index 84ffe00112..c8aec95333 100644 --- a/charts/flyte-binary/values.yaml +++ b/charts/flyte-binary/values.yaml @@ -149,7 +149,7 @@ configuration: # repository CoPilot sidecar image repository repository: cr.flyte.org/flyteorg/flytecopilot # FLYTECOPILOT_IMAGE # tag CoPilot sidecar image tag - tag: v1.9.4 # FLYTECOPILOT_TAG + tag: v1.9.37 # FLYTECOPILOT_TAG # agentService Flyte Agent configuration agentService: defaultAgent: diff --git a/charts/flyte-core/README.md b/charts/flyte-core/README.md index b4c05b623d..4610da1009 100644 --- a/charts/flyte-core/README.md +++ b/charts/flyte-core/README.md @@ -90,8 +90,8 @@ helm install gateway bitnami/contour -n flyte | configmap.clusters.clusterConfigs | list | `[]` | | | configmap.clusters.labelClusterMap | object | `{}` | | | configmap.console | object | `{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"}` | Configuration for Flyte console UI | -| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration | -| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) | +| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration | +| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) | | configmap.core | object | `{"manager":{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"},"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}}` | Core propeller configuration | | configmap.core.manager | object | `{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/manager/config#Config). | | configmap.core.propeller | object | `{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controller/config). | @@ -125,7 +125,7 @@ helm install gateway bitnami/contour -n flyte | datacatalog.extraArgs | object | `{}` | Appends extra command line arguments to the main command | | datacatalog.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | datacatalog.image.repository | string | `"cr.flyte.org/flyteorg/datacatalog"` | Docker image for Datacatalog deployment | -| datacatalog.image.tag | string | `"v1.9.4"` | Docker image tag | +| datacatalog.image.tag | string | `"v1.9.37"` | Docker image tag | | datacatalog.nodeSelector | object | `{}` | nodeSelector for Datacatalog deployment | | datacatalog.podAnnotations | object | `{}` | Annotations for Datacatalog pods | | datacatalog.priorityClassName | string | `""` | Sets priorityClassName for datacatalog pod(s). | @@ -157,7 +157,7 @@ helm install gateway bitnami/contour -n flyte | flyteadmin.extraArgs | object | `{}` | Appends extra command line arguments to the serve command | | flyteadmin.image.pullPolicy | string | `"IfNotPresent"` | | | flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment | -| flyteadmin.image.tag | string | `"v1.9.4"` | | +| flyteadmin.image.tag | string | `"v1.9.37"` | | | flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create | | flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment | | flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods | @@ -184,7 +184,7 @@ helm install gateway bitnami/contour -n flyte | flyteconsole.ga.tracking_id | string | `"G-0QW4DJWJ20"` | | | flyteconsole.image.pullPolicy | string | `"IfNotPresent"` | | | flyteconsole.image.repository | string | `"cr.flyte.org/flyteorg/flyteconsole"` | Docker image for Flyteconsole deployment | -| flyteconsole.image.tag | string | `"v1.9.6"` | | +| flyteconsole.image.tag | string | `"v1.10.2"` | | | flyteconsole.nodeSelector | object | `{}` | nodeSelector for Flyteconsole deployment | | flyteconsole.podAnnotations | object | `{}` | Annotations for Flyteconsole pods | | flyteconsole.priorityClassName | string | `""` | Sets priorityClassName for flyte console pod(s). | @@ -204,7 +204,7 @@ helm install gateway bitnami/contour -n flyte | flytepropeller.extraArgs | object | `{}` | Appends extra command line arguments to the main command | | flytepropeller.image.pullPolicy | string | `"IfNotPresent"` | | | flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment | -| flytepropeller.image.tag | string | `"v1.9.4"` | | +| flytepropeller.image.tag | string | `"v1.9.37"` | | | flytepropeller.manager | bool | `false` | | | flytepropeller.nodeSelector | object | `{}` | nodeSelector for Flytepropeller deployment | | flytepropeller.podAnnotations | object | `{}` | Annotations for Flytepropeller pods | @@ -224,7 +224,7 @@ helm install gateway bitnami/contour -n flyte | flytescheduler.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files | | flytescheduler.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flytescheduler.image.repository | string | `"cr.flyte.org/flyteorg/flytescheduler"` | Docker image for Flytescheduler deployment | -| flytescheduler.image.tag | string | `"v1.9.4"` | Docker image tag | +| flytescheduler.image.tag | string | `"v1.9.37"` | Docker image tag | | flytescheduler.nodeSelector | object | `{}` | nodeSelector for Flytescheduler deployment | | flytescheduler.podAnnotations | object | `{}` | Annotations for Flytescheduler pods | | flytescheduler.priorityClassName | string | `""` | Sets priorityClassName for flyte scheduler pod(s). | diff --git a/charts/flyte-core/values.yaml b/charts/flyte-core/values.yaml index 300c7795a5..7ad1707e89 100755 --- a/charts/flyte-core/values.yaml +++ b/charts/flyte-core/values.yaml @@ -16,7 +16,7 @@ flyteadmin: image: # -- Docker image for Flyteadmin deployment repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE - tag: v1.9.4 # FLYTEADMIN_TAG + tag: v1.9.37 # FLYTEADMIN_TAG pullPolicy: IfNotPresent # -- Additional flyteadmin container environment variables # @@ -121,7 +121,7 @@ flytescheduler: # -- Docker image for Flytescheduler deployment repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE # -- Docker image tag - tag: v1.9.4 # FLYTESCHEDULER_TAG + tag: v1.9.37 # FLYTESCHEDULER_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Flytescheduler deployment @@ -175,7 +175,7 @@ datacatalog: # -- Docker image for Datacatalog deployment repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE # -- Docker image tag - tag: v1.9.4 # DATACATALOG_TAG + tag: v1.9.37 # DATACATALOG_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Datacatalog deployment @@ -243,7 +243,7 @@ flytepropeller: image: # -- Docker image for Flytepropeller deployment repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE - tag: v1.9.4 # FLYTEPROPELLER_TAG + tag: v1.9.37 # FLYTEPROPELLER_TAG pullPolicy: IfNotPresent # -- Default resources requests and limits for Flytepropeller deployment resources: @@ -301,7 +301,7 @@ flyteconsole: image: # -- Docker image for Flyteconsole deployment repository: cr.flyte.org/flyteorg/flyteconsole # FLYTECONSOLE_IMAGE - tag: v1.9.6 # FLYTECONSOLE_TAG + tag: v1.10.2 # FLYTECONSOLE_TAG pullPolicy: IfNotPresent # -- Default resources requests and limits for Flyteconsole deployment resources: @@ -627,7 +627,7 @@ configmap: # -- Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) co-pilot: name: flyte-copilot- - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 # FLYTECOPILOT_IMAGE + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 # FLYTECOPILOT_IMAGE start-timeout: 30s # -- Core propeller configuration diff --git a/charts/flyte/README.md b/charts/flyte/README.md index b2d9b433fd..7ed1679354 100644 --- a/charts/flyte/README.md +++ b/charts/flyte/README.md @@ -71,7 +71,7 @@ helm upgrade -f values-sandbox.yaml flyte . | contour.tolerations | list | `[]` | tolerations for Contour deployment | | daskoperator | object | `{"enabled":false}` | Optional: Dask Plugin using the Dask Operator | | daskoperator.enabled | bool | `false` | - enable or disable the dask operator deployment installation | -| flyte | object | `{"cluster_resource_manager":{"config":{"cluster_resources":{"customData":[{"production":[{"projectQuotaCpu":{"value":"5"}},{"projectQuotaMemory":{"value":"4000Mi"}}]},{"staging":[{"projectQuotaCpu":{"value":"2"}},{"projectQuotaMemory":{"value":"3000Mi"}}]},{"development":[{"projectQuotaCpu":{"value":"4"}},{"projectQuotaMemory":{"value":"3000Mi"}}]}],"refresh":"5m","refreshInterval":"5m","standaloneDeployment":false,"templatePath":"/etc/flyte/clusterresource/templates"}},"enabled":true,"service_account_name":"flyteadmin","templates":[{"key":"aa_namespace","value":"apiVersion: v1\nkind: Namespace\nmetadata:\n name: {{ namespace }}\nspec:\n finalizers:\n - kubernetes\n"},{"key":"ab_project_resource_quota","value":"apiVersion: v1\nkind: ResourceQuota\nmetadata:\n name: project-quota\n namespace: {{ namespace }}\nspec:\n hard:\n limits.cpu: {{ projectQuotaCpu }}\n limits.memory: {{ projectQuotaMemory }}\n"}]},"common":{"databaseSecret":{"name":"","secretManifest":{}},"flyteNamespaceTemplate":{"enabled":false},"ingress":{"albSSLRedirect":false,"annotations":{"nginx.ingress.kubernetes.io/app-root":"/console"},"enabled":true,"host":"","separateGrpcIngress":false,"separateGrpcIngressAnnotations":{"nginx.ingress.kubernetes.io/backend-protocol":"GRPC"},"tls":{"enabled":false},"webpackHMR":true}},"configmap":{"adminServer":{"auth":{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}},"flyteadmin":{"eventVersion":2,"metadataStoragePrefix":["metadata","admin"],"metricsScope":"flyte:","profilerPort":10254,"roleNameKey":"iam.amazonaws.com/role","testing":{"host":"http://flyteadmin"}},"server":{"grpcPort":8089,"httpPort":8088,"security":{"allowCors":true,"allowedHeaders":["Content-Type","flyte-authorization"],"allowedOrigins":["*"],"secure":false,"useAuth":false}}},"catalog":{"catalog-cache":{"endpoint":"datacatalog:89","insecure":true,"type":"datacatalog"}},"console":{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"},"copilot":{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}}}},"core":{"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}},"datacatalogServer":{"application":{"grpcPort":8089,"grpcServerReflection":true,"httpPort":8080},"datacatalog":{"metrics-scope":"datacatalog","profiler-port":10254,"storage-prefix":"metadata/datacatalog"}},"domain":{"domains":[{"id":"development","name":"development"},{"id":"staging","name":"staging"},{"id":"production","name":"production"}]},"enabled_plugins":{"tasks":{"task-plugins":{"default-for-task-types":{"bigquery_query_job_task":"agent-service","container":"container","container_array":"k8s-array","sidecar":"sidecar"},"enabled-plugins":["container","sidecar","k8s-array","agent-service"]}}},"k8s":{"plugins":{"agent-service":{"defaultAgent":{"endpoint":"dns:///flyteagent.flyte.svc.cluster.local:8000","insecure":true},"supportedTaskTypes":["bigquery_query_job_task"]},"k8s":{"default-cpus":"100m","default-env-vars":[{"FLYTE_AWS_ENDPOINT":"http://minio.flyte:9000"},{"FLYTE_AWS_ACCESS_KEY_ID":"minio"},{"FLYTE_AWS_SECRET_ACCESS_KEY":"miniostorage"}],"default-memory":"200Mi"}}},"logger":{"logger":{"level":5,"show-source":true}},"remoteData":{"remoteData":{"region":"us-east-1","scheme":"local","signedUrls":{"durationMinutes":3}}},"resource_manager":{"propeller":{"resourcemanager":{"redis":null,"type":"noop"}}},"task_logs":{"plugins":{"logs":{"cloudwatch-enabled":false,"kubernetes-enabled":true,"kubernetes-template-uri":"http://localhost:30082/#/log/{{ \"{{\" }} .namespace {{ \"}}\" }}/{{ \"{{\" }} .podName {{ \"}}\" }}/pod?namespace={{ \"{{\" }} .namespace {{ \"}}\" }}"}}},"task_resource_defaults":{"task_resources":{"defaults":{"cpu":"100m","memory":"200Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}}},"datacatalog":{"affinity":{},"configPath":"/etc/datacatalog/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/datacatalog","tag":"v1.9.4"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"NodePort"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"db":{"admin":{"database":{"dbname":"flyteadmin","host":"postgres","port":5432,"username":"postgres"}},"datacatalog":{"database":{"dbname":"datacatalog","host":"postgres","port":5432,"username":"postgres"}}},"deployRedoc":true,"flyteadmin":{"additionalVolumeMounts":[],"additionalVolumes":[],"affinity":{},"configPath":"/etc/flyte/config/*.yaml","env":[],"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteadmin","tag":"v1.9.4"},"initialProjects":["flytesnacks","flytetester","flyteexamples"],"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"250m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"secrets":{},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"loadBalancerSourceRanges":[],"type":"ClusterIP"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"flyteconsole":{"affinity":{},"ga":{"enabled":true,"tracking_id":"G-0QW4DJWJ20"},"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteconsole","tag":"v1.9.6"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","memory":"275Mi"},"requests":{"cpu":"10m","memory":"250Mi"}},"service":{"annotations":{},"type":"ClusterIP"},"tolerations":[]},"flytepropeller":{"affinity":{},"cacheSizeMbs":0,"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytepropeller","tag":"v1.9.4"},"manager":false,"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"200m","ephemeral-storage":"100Mi","memory":"200Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"flytescheduler":{"affinity":{},"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytescheduler","tag":"v1.9.4"},"nodeSelector":{},"podAnnotations":{},"resources":{"limits":{"cpu":"250m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"secrets":{},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"storage":{"bucketName":"my-s3-bucket","custom":{},"gcs":null,"s3":{"region":"us-east-1"},"type":"sandbox"},"webhook":{"enabled":true,"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"ClusterIP"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]}},"workflow_notifications":{"config":{},"enabled":false},"workflow_scheduler":{"enabled":true,"type":"native"}}` | ------------------------------------------------------------------- Core System settings This section consists of Core components of Flyte and their deployment settings. This includes FlyteAdmin service, Datacatalog, FlytePropeller and Flyteconsole | +| flyte | object | `{"cluster_resource_manager":{"config":{"cluster_resources":{"customData":[{"production":[{"projectQuotaCpu":{"value":"5"}},{"projectQuotaMemory":{"value":"4000Mi"}}]},{"staging":[{"projectQuotaCpu":{"value":"2"}},{"projectQuotaMemory":{"value":"3000Mi"}}]},{"development":[{"projectQuotaCpu":{"value":"4"}},{"projectQuotaMemory":{"value":"3000Mi"}}]}],"refresh":"5m","refreshInterval":"5m","standaloneDeployment":false,"templatePath":"/etc/flyte/clusterresource/templates"}},"enabled":true,"service_account_name":"flyteadmin","templates":[{"key":"aa_namespace","value":"apiVersion: v1\nkind: Namespace\nmetadata:\n name: {{ namespace }}\nspec:\n finalizers:\n - kubernetes\n"},{"key":"ab_project_resource_quota","value":"apiVersion: v1\nkind: ResourceQuota\nmetadata:\n name: project-quota\n namespace: {{ namespace }}\nspec:\n hard:\n limits.cpu: {{ projectQuotaCpu }}\n limits.memory: {{ projectQuotaMemory }}\n"}]},"common":{"databaseSecret":{"name":"","secretManifest":{}},"flyteNamespaceTemplate":{"enabled":false},"ingress":{"albSSLRedirect":false,"annotations":{"nginx.ingress.kubernetes.io/app-root":"/console"},"enabled":true,"host":"","separateGrpcIngress":false,"separateGrpcIngressAnnotations":{"nginx.ingress.kubernetes.io/backend-protocol":"GRPC"},"tls":{"enabled":false},"webpackHMR":true}},"configmap":{"adminServer":{"auth":{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}},"flyteadmin":{"eventVersion":2,"metadataStoragePrefix":["metadata","admin"],"metricsScope":"flyte:","profilerPort":10254,"roleNameKey":"iam.amazonaws.com/role","testing":{"host":"http://flyteadmin"}},"server":{"grpcPort":8089,"httpPort":8088,"security":{"allowCors":true,"allowedHeaders":["Content-Type","flyte-authorization"],"allowedOrigins":["*"],"secure":false,"useAuth":false}}},"catalog":{"catalog-cache":{"endpoint":"datacatalog:89","insecure":true,"type":"datacatalog"}},"console":{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"},"copilot":{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}}}},"core":{"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}},"datacatalogServer":{"application":{"grpcPort":8089,"grpcServerReflection":true,"httpPort":8080},"datacatalog":{"metrics-scope":"datacatalog","profiler-port":10254,"storage-prefix":"metadata/datacatalog"}},"domain":{"domains":[{"id":"development","name":"development"},{"id":"staging","name":"staging"},{"id":"production","name":"production"}]},"enabled_plugins":{"tasks":{"task-plugins":{"default-for-task-types":{"bigquery_query_job_task":"agent-service","container":"container","container_array":"k8s-array","sidecar":"sidecar"},"enabled-plugins":["container","sidecar","k8s-array","agent-service"]}}},"k8s":{"plugins":{"agent-service":{"defaultAgent":{"endpoint":"dns:///flyteagent.flyte.svc.cluster.local:8000","insecure":true},"supportedTaskTypes":["bigquery_query_job_task"]},"k8s":{"default-cpus":"100m","default-env-vars":[{"FLYTE_AWS_ENDPOINT":"http://minio.flyte:9000"},{"FLYTE_AWS_ACCESS_KEY_ID":"minio"},{"FLYTE_AWS_SECRET_ACCESS_KEY":"miniostorage"}],"default-memory":"200Mi"}}},"logger":{"logger":{"level":5,"show-source":true}},"remoteData":{"remoteData":{"region":"us-east-1","scheme":"local","signedUrls":{"durationMinutes":3}}},"resource_manager":{"propeller":{"resourcemanager":{"redis":null,"type":"noop"}}},"task_logs":{"plugins":{"logs":{"cloudwatch-enabled":false,"kubernetes-enabled":true,"kubernetes-template-uri":"http://localhost:30082/#/log/{{ \"{{\" }} .namespace {{ \"}}\" }}/{{ \"{{\" }} .podName {{ \"}}\" }}/pod?namespace={{ \"{{\" }} .namespace {{ \"}}\" }}"}}},"task_resource_defaults":{"task_resources":{"defaults":{"cpu":"100m","memory":"200Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}}},"datacatalog":{"affinity":{},"configPath":"/etc/datacatalog/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/datacatalog","tag":"v1.9.37"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"NodePort"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"db":{"admin":{"database":{"dbname":"flyteadmin","host":"postgres","port":5432,"username":"postgres"}},"datacatalog":{"database":{"dbname":"datacatalog","host":"postgres","port":5432,"username":"postgres"}}},"deployRedoc":true,"flyteadmin":{"additionalVolumeMounts":[],"additionalVolumes":[],"affinity":{},"configPath":"/etc/flyte/config/*.yaml","env":[],"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteadmin","tag":"v1.9.37"},"initialProjects":["flytesnacks","flytetester","flyteexamples"],"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"250m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"secrets":{},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"loadBalancerSourceRanges":[],"type":"ClusterIP"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"flyteconsole":{"affinity":{},"ga":{"enabled":true,"tracking_id":"G-0QW4DJWJ20"},"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteconsole","tag":"v1.10.2"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","memory":"275Mi"},"requests":{"cpu":"10m","memory":"250Mi"}},"service":{"annotations":{},"type":"ClusterIP"},"tolerations":[]},"flytepropeller":{"affinity":{},"cacheSizeMbs":0,"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytepropeller","tag":"v1.9.37"},"manager":false,"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"200m","ephemeral-storage":"100Mi","memory":"200Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"flytescheduler":{"affinity":{},"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytescheduler","tag":"v1.9.37"},"nodeSelector":{},"podAnnotations":{},"resources":{"limits":{"cpu":"250m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"secrets":{},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]},"tolerations":[]},"storage":{"bucketName":"my-s3-bucket","custom":{},"gcs":null,"s3":{"region":"us-east-1"},"type":"sandbox"},"webhook":{"enabled":true,"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"ClusterIP"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":[]}},"workflow_notifications":{"config":{},"enabled":false},"workflow_scheduler":{"enabled":true,"type":"native"}}` | ------------------------------------------------------------------- Core System settings This section consists of Core components of Flyte and their deployment settings. This includes FlyteAdmin service, Datacatalog, FlytePropeller and Flyteconsole | | flyte.cluster_resource_manager | object | `{"config":{"cluster_resources":{"customData":[{"production":[{"projectQuotaCpu":{"value":"5"}},{"projectQuotaMemory":{"value":"4000Mi"}}]},{"staging":[{"projectQuotaCpu":{"value":"2"}},{"projectQuotaMemory":{"value":"3000Mi"}}]},{"development":[{"projectQuotaCpu":{"value":"4"}},{"projectQuotaMemory":{"value":"3000Mi"}}]}],"refresh":"5m","refreshInterval":"5m","standaloneDeployment":false,"templatePath":"/etc/flyte/clusterresource/templates"}},"enabled":true,"service_account_name":"flyteadmin","templates":[{"key":"aa_namespace","value":"apiVersion: v1\nkind: Namespace\nmetadata:\n name: {{ namespace }}\nspec:\n finalizers:\n - kubernetes\n"},{"key":"ab_project_resource_quota","value":"apiVersion: v1\nkind: ResourceQuota\nmetadata:\n name: project-quota\n namespace: {{ namespace }}\nspec:\n hard:\n limits.cpu: {{ projectQuotaCpu }}\n limits.memory: {{ projectQuotaMemory }}\n"}]}` | Configuration for the Cluster resource manager component. This is an optional component, that enables automatic cluster configuration. This is useful to set default quotas, manage namespaces etc that map to a project/domain | | flyte.cluster_resource_manager.config.cluster_resources | object | `{"customData":[{"production":[{"projectQuotaCpu":{"value":"5"}},{"projectQuotaMemory":{"value":"4000Mi"}}]},{"staging":[{"projectQuotaCpu":{"value":"2"}},{"projectQuotaMemory":{"value":"3000Mi"}}]},{"development":[{"projectQuotaCpu":{"value":"4"}},{"projectQuotaMemory":{"value":"3000Mi"}}]}],"refresh":"5m","refreshInterval":"5m","standaloneDeployment":false,"templatePath":"/etc/flyte/clusterresource/templates"}` | ClusterResource parameters Refer to the [structure](https://pkg.go.dev/github.com/lyft/flyteadmin@v0.3.37/pkg/runtime/interfaces#ClusterResourceConfig) to customize. | | flyte.cluster_resource_manager.config.cluster_resources.standaloneDeployment | bool | `false` | Starts the cluster resource manager in standalone mode with requisite auth credentials to call flyteadmin service endpoints | @@ -91,15 +91,15 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.common.ingress.separateGrpcIngressAnnotations | object | `{"nginx.ingress.kubernetes.io/backend-protocol":"GRPC"}` | - Extra Ingress annotations applied only to the GRPC ingress. Only makes sense if `separateGrpcIngress` is enabled. | | flyte.common.ingress.tls | object | `{"enabled":false}` | - TLS Settings | | flyte.common.ingress.webpackHMR | bool | `true` | - Enable or disable HMR route to flyteconsole. This is useful only for frontend development. | -| flyte.configmap | object | `{"adminServer":{"auth":{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}},"flyteadmin":{"eventVersion":2,"metadataStoragePrefix":["metadata","admin"],"metricsScope":"flyte:","profilerPort":10254,"roleNameKey":"iam.amazonaws.com/role","testing":{"host":"http://flyteadmin"}},"server":{"grpcPort":8089,"httpPort":8088,"security":{"allowCors":true,"allowedHeaders":["Content-Type","flyte-authorization"],"allowedOrigins":["*"],"secure":false,"useAuth":false}}},"catalog":{"catalog-cache":{"endpoint":"datacatalog:89","insecure":true,"type":"datacatalog"}},"console":{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"},"copilot":{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}}}},"core":{"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}},"datacatalogServer":{"application":{"grpcPort":8089,"grpcServerReflection":true,"httpPort":8080},"datacatalog":{"metrics-scope":"datacatalog","profiler-port":10254,"storage-prefix":"metadata/datacatalog"}},"domain":{"domains":[{"id":"development","name":"development"},{"id":"staging","name":"staging"},{"id":"production","name":"production"}]},"enabled_plugins":{"tasks":{"task-plugins":{"default-for-task-types":{"bigquery_query_job_task":"agent-service","container":"container","container_array":"k8s-array","sidecar":"sidecar"},"enabled-plugins":["container","sidecar","k8s-array","agent-service"]}}},"k8s":{"plugins":{"agent-service":{"defaultAgent":{"endpoint":"dns:///flyteagent.flyte.svc.cluster.local:8000","insecure":true},"supportedTaskTypes":["bigquery_query_job_task"]},"k8s":{"default-cpus":"100m","default-env-vars":[{"FLYTE_AWS_ENDPOINT":"http://minio.flyte:9000"},{"FLYTE_AWS_ACCESS_KEY_ID":"minio"},{"FLYTE_AWS_SECRET_ACCESS_KEY":"miniostorage"}],"default-memory":"200Mi"}}},"logger":{"logger":{"level":5,"show-source":true}},"remoteData":{"remoteData":{"region":"us-east-1","scheme":"local","signedUrls":{"durationMinutes":3}}},"resource_manager":{"propeller":{"resourcemanager":{"redis":null,"type":"noop"}}},"task_logs":{"plugins":{"logs":{"cloudwatch-enabled":false,"kubernetes-enabled":true,"kubernetes-template-uri":"http://localhost:30082/#/log/{{ \"{{\" }} .namespace {{ \"}}\" }}/{{ \"{{\" }} .podName {{ \"}}\" }}/pod?namespace={{ \"{{\" }} .namespace {{ \"}}\" }}"}}},"task_resource_defaults":{"task_resources":{"defaults":{"cpu":"100m","memory":"200Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}}}` | ----------------------------------------------------------------- CONFIGMAPS SETTINGS | +| flyte.configmap | object | `{"adminServer":{"auth":{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}},"flyteadmin":{"eventVersion":2,"metadataStoragePrefix":["metadata","admin"],"metricsScope":"flyte:","profilerPort":10254,"roleNameKey":"iam.amazonaws.com/role","testing":{"host":"http://flyteadmin"}},"server":{"grpcPort":8089,"httpPort":8088,"security":{"allowCors":true,"allowedHeaders":["Content-Type","flyte-authorization"],"allowedOrigins":["*"],"secure":false,"useAuth":false}}},"catalog":{"catalog-cache":{"endpoint":"datacatalog:89","insecure":true,"type":"datacatalog"}},"console":{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"},"copilot":{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}}}},"core":{"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}},"datacatalogServer":{"application":{"grpcPort":8089,"grpcServerReflection":true,"httpPort":8080},"datacatalog":{"metrics-scope":"datacatalog","profiler-port":10254,"storage-prefix":"metadata/datacatalog"}},"domain":{"domains":[{"id":"development","name":"development"},{"id":"staging","name":"staging"},{"id":"production","name":"production"}]},"enabled_plugins":{"tasks":{"task-plugins":{"default-for-task-types":{"bigquery_query_job_task":"agent-service","container":"container","container_array":"k8s-array","sidecar":"sidecar"},"enabled-plugins":["container","sidecar","k8s-array","agent-service"]}}},"k8s":{"plugins":{"agent-service":{"defaultAgent":{"endpoint":"dns:///flyteagent.flyte.svc.cluster.local:8000","insecure":true},"supportedTaskTypes":["bigquery_query_job_task"]},"k8s":{"default-cpus":"100m","default-env-vars":[{"FLYTE_AWS_ENDPOINT":"http://minio.flyte:9000"},{"FLYTE_AWS_ACCESS_KEY_ID":"minio"},{"FLYTE_AWS_SECRET_ACCESS_KEY":"miniostorage"}],"default-memory":"200Mi"}}},"logger":{"logger":{"level":5,"show-source":true}},"remoteData":{"remoteData":{"region":"us-east-1","scheme":"local","signedUrls":{"durationMinutes":3}}},"resource_manager":{"propeller":{"resourcemanager":{"redis":null,"type":"noop"}}},"task_logs":{"plugins":{"logs":{"cloudwatch-enabled":false,"kubernetes-enabled":true,"kubernetes-template-uri":"http://localhost:30082/#/log/{{ \"{{\" }} .namespace {{ \"}}\" }}/{{ \"{{\" }} .podName {{ \"}}\" }}/pod?namespace={{ \"{{\" }} .namespace {{ \"}}\" }}"}}},"task_resource_defaults":{"task_resources":{"defaults":{"cpu":"100m","memory":"200Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}}}` | ----------------------------------------------------------------- CONFIGMAPS SETTINGS | | flyte.configmap.adminServer | object | `{"auth":{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}},"flyteadmin":{"eventVersion":2,"metadataStoragePrefix":["metadata","admin"],"metricsScope":"flyte:","profilerPort":10254,"roleNameKey":"iam.amazonaws.com/role","testing":{"host":"http://flyteadmin"}},"server":{"grpcPort":8089,"httpPort":8088,"security":{"allowCors":true,"allowedHeaders":["Content-Type","flyte-authorization"],"allowedOrigins":["*"],"secure":false,"useAuth":false}}}` | FlyteAdmin server configuration | | flyte.configmap.adminServer.auth | object | `{"appAuth":{"thirdPartyConfig":{"flyteClient":{"clientId":"flytectl","redirectUri":"http://localhost:53593/callback","scopes":["offline","all"]}}},"authorizedUris":["https://localhost:30081","http://flyteadmin:80","http://flyteadmin.flyte.svc.cluster.local:80"],"userAuth":{"openId":{"baseUrl":"https://accounts.google.com","clientId":"657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com","scopes":["profile","openid"]}}}` | Authentication configuration | | flyte.configmap.adminServer.server.security.secure | bool | `false` | Controls whether to serve requests over SSL/TLS. | | flyte.configmap.adminServer.server.security.useAuth | bool | `false` | Controls whether to enforce authentication. Follow the guide in https://docs.flyte.org/ on how to setup authentication. | | flyte.configmap.catalog | object | `{"catalog-cache":{"endpoint":"datacatalog:89","insecure":true,"type":"datacatalog"}}` | Catalog Client configuration [structure](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controller/nodes/task/catalog#Config) Additional advanced Catalog configuration [here](https://pkg.go.dev/github.com/lyft/flyteplugins/go/tasks/pluginmachinery/catalog#Config) | | flyte.configmap.console | object | `{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"}` | Configuration for Flyte console UI | -| flyte.configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration | -| flyte.configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.4","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) | +| flyte.configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration | +| flyte.configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.9.37","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) | | flyte.configmap.core | object | `{"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}}` | Core propeller configuration | | flyte.configmap.core.propeller | object | `{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controller/config). | | flyte.configmap.datacatalogServer | object | `{"application":{"grpcPort":8089,"grpcServerReflection":true,"httpPort":8080},"datacatalog":{"metrics-scope":"datacatalog","profiler-port":10254,"storage-prefix":"metadata/datacatalog"}}` | Datacatalog server config | @@ -120,7 +120,7 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.datacatalog.configPath | string | `"/etc/datacatalog/config/*.yaml"` | Default regex string for searching configuration files | | flyte.datacatalog.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flyte.datacatalog.image.repository | string | `"cr.flyte.org/flyteorg/datacatalog"` | Docker image for Datacatalog deployment | -| flyte.datacatalog.image.tag | string | `"v1.9.4"` | Docker image tag | +| flyte.datacatalog.image.tag | string | `"v1.9.37"` | Docker image tag | | flyte.datacatalog.nodeSelector | object | `{}` | nodeSelector for Datacatalog deployment | | flyte.datacatalog.podAnnotations | object | `{}` | Annotations for Datacatalog pods | | flyte.datacatalog.replicaCount | int | `1` | Replicas count for Datacatalog deployment | @@ -136,7 +136,7 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.flyteadmin.env | list | `[]` | Additional flyteadmin container environment variables e.g. SendGrid's API key - name: SENDGRID_API_KEY value: "" e.g. secret environment variable (you can combine it with .additionalVolumes): - name: SENDGRID_API_KEY valueFrom: secretKeyRef: name: sendgrid-secret key: api_key | | flyte.flyteadmin.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flyte.flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment | -| flyte.flyteadmin.image.tag | string | `"v1.9.4"` | Docker image tag | +| flyte.flyteadmin.image.tag | string | `"v1.9.37"` | Docker image tag | | flyte.flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create | | flyte.flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment | | flyte.flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods | @@ -151,7 +151,7 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.flyteconsole.affinity | object | `{}` | affinity for Flyteconsole deployment | | flyte.flyteconsole.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flyte.flyteconsole.image.repository | string | `"cr.flyte.org/flyteorg/flyteconsole"` | Docker image for Flyteconsole deployment | -| flyte.flyteconsole.image.tag | string | `"v1.9.6"` | Docker image tag | +| flyte.flyteconsole.image.tag | string | `"v1.10.2"` | Docker image tag | | flyte.flyteconsole.nodeSelector | object | `{}` | nodeSelector for Flyteconsole deployment | | flyte.flyteconsole.podAnnotations | object | `{}` | Annotations for Flyteconsole pods | | flyte.flyteconsole.replicaCount | int | `1` | Replicas count for Flyteconsole deployment | @@ -162,7 +162,7 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.flytepropeller.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files | | flyte.flytepropeller.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flyte.flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment | -| flyte.flytepropeller.image.tag | string | `"v1.9.4"` | Docker image tag | +| flyte.flytepropeller.image.tag | string | `"v1.9.37"` | Docker image tag | | flyte.flytepropeller.nodeSelector | object | `{}` | nodeSelector for Flytepropeller deployment | | flyte.flytepropeller.podAnnotations | object | `{}` | Annotations for Flytepropeller pods | | flyte.flytepropeller.replicaCount | int | `1` | Replicas count for Flytepropeller deployment | @@ -176,7 +176,7 @@ helm upgrade -f values-sandbox.yaml flyte . | flyte.flytescheduler.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files | | flyte.flytescheduler.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | flyte.flytescheduler.image.repository | string | `"cr.flyte.org/flyteorg/flytescheduler"` | Docker image for Flytescheduler deployment | -| flyte.flytescheduler.image.tag | string | `"v1.9.4"` | Docker image tag | +| flyte.flytescheduler.image.tag | string | `"v1.9.37"` | Docker image tag | | flyte.flytescheduler.nodeSelector | object | `{}` | nodeSelector for Flytescheduler deployment | | flyte.flytescheduler.podAnnotations | object | `{}` | Annotations for Flytescheduler pods | | flyte.flytescheduler.resources | object | `{"limits":{"cpu":"250m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}}` | Default resources requests and limits for Flytescheduler deployment | diff --git a/charts/flyte/values.yaml b/charts/flyte/values.yaml index 440af7fa70..2d43c13fe3 100755 --- a/charts/flyte/values.yaml +++ b/charts/flyte/values.yaml @@ -16,7 +16,7 @@ flyte: # -- Docker image for Flyteadmin deployment repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE # -- Docker image tag - tag: v1.9.4 # FLYTEADMIN_TAG + tag: v1.9.37 # FLYTEADMIN_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Additional flyteadmin container environment variables @@ -84,7 +84,7 @@ flyte: # -- Docker image for Flytescheduler deployment repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE # -- Docker image tag - tag: v1.9.4 # FLYTESCHEDULER_TAG + tag: v1.9.37 # FLYTESCHEDULER_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Flytescheduler deployment @@ -129,7 +129,7 @@ flyte: # -- Docker image for Datacatalog deployment repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE # -- Docker image tag - tag: v1.9.4 # DATACATALOG_TAG + tag: v1.9.37 # DATACATALOG_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Datacatalog deployment @@ -178,7 +178,7 @@ flyte: # -- Docker image for Flytepropeller deployment repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE # -- Docker image tag - tag: v1.9.4 # FLYTEPROPELLER_TAG + tag: v1.9.37 # FLYTEPROPELLER_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Flytepropeller deployment @@ -223,7 +223,7 @@ flyte: # -- Docker image for Flyteconsole deployment repository: cr.flyte.org/flyteorg/flyteconsole # FLYTECONSOLE_IMAGE # -- Docker image tag - tag: v1.9.6 # FLYTECONSOLE_TAG + tag: v1.10.2 # FLYTECONSOLE_TAG # -- Docker image pull policy pullPolicy: IfNotPresent # -- Default resources requests and limits for Flyteconsole deployment @@ -471,7 +471,7 @@ flyte: # -- Structure documented [here](https://pkg.go.dev/github.com/lyft/flyteplugins@v0.5.28/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) co-pilot: name: flyte-copilot- - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 # FLYTECOPILOT_IMAGE + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 # FLYTECOPILOT_IMAGE start-timeout: 30s # -- Core propeller configuration diff --git a/charts/flyteagent/README.md b/charts/flyteagent/README.md index c45f994816..e7a30865dc 100644 --- a/charts/flyteagent/README.md +++ b/charts/flyteagent/README.md @@ -20,7 +20,7 @@ A Helm chart for Flyte agent | fullnameOverride | string | `""` | | | image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy | | image.repository | string | `"ghcr.io/flyteorg/flyteagent"` | Docker image for flyteagent deployment | -| image.tag | string | `"1.9.1"` | Docker image tag | +| image.tag | string | `"1.10.0"` | Docker image tag | | nameOverride | string | `""` | | | nodeSelector | object | `{}` | nodeSelector for flyteagent deployment | | podAnnotations | object | `{}` | Annotations for flyteagent pods | diff --git a/charts/flyteagent/values.yaml b/charts/flyteagent/values.yaml index 8a40180e45..c3a31e028d 100755 --- a/charts/flyteagent/values.yaml +++ b/charts/flyteagent/values.yaml @@ -23,7 +23,7 @@ image: # -- Docker image for flyteagent deployment repository: ghcr.io/flyteorg/flyteagent # -- Docker image tag - tag: 1.9.1 # FLYTEAGENT_TAG + tag: 1.10.0 # FLYTEAGENT_TAG # -- Docker image pull policy pullPolicy: IfNotPresent ports: diff --git a/deployment/agent/flyte_agent_helm_generated.yaml b/deployment/agent/flyte_agent_helm_generated.yaml index 89f3835892..f7d538770b 100644 --- a/deployment/agent/flyte_agent_helm_generated.yaml +++ b/deployment/agent/flyte_agent_helm_generated.yaml @@ -75,7 +75,7 @@ spec: - command: - pyflyte - serve - image: "ghcr.io/flyteorg/flyteagent:1.9.1" + image: "ghcr.io/flyteorg/flyteagent:1.10.0" imagePullPolicy: "IfNotPresent" name: flyteagent volumeMounts: diff --git a/deployment/eks/flyte_aws_scheduler_helm_generated.yaml b/deployment/eks/flyte_aws_scheduler_helm_generated.yaml index 483b60ec08..a05c6869df 100644 --- a/deployment/eks/flyte_aws_scheduler_helm_generated.yaml +++ b/deployment/eks/flyte_aws_scheduler_helm_generated.yaml @@ -429,7 +429,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -869,7 +869,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -886,7 +886,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -900,7 +900,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -913,7 +913,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -936,7 +936,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -1037,7 +1037,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -1090,7 +1090,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -1157,7 +1157,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -1171,7 +1171,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -1230,7 +1230,7 @@ spec: template: metadata: annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -1256,7 +1256,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -1310,9 +1310,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" spec: securityContext: fsGroup: 65534 @@ -1321,7 +1321,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -1344,7 +1344,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/deployment/eks/flyte_helm_controlplane_generated.yaml b/deployment/eks/flyte_helm_controlplane_generated.yaml index 47171b8666..323176fea1 100644 --- a/deployment/eks/flyte_helm_controlplane_generated.yaml +++ b/deployment/eks/flyte_helm_controlplane_generated.yaml @@ -575,7 +575,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -592,7 +592,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -606,7 +606,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -619,7 +619,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -642,7 +642,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -743,7 +743,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -796,7 +796,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -863,7 +863,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -877,7 +877,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -953,7 +953,7 @@ spec: - precheck - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler-check volumeMounts: @@ -969,7 +969,7 @@ spec: - run - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler ports: diff --git a/deployment/eks/flyte_helm_dataplane_generated.yaml b/deployment/eks/flyte_helm_dataplane_generated.yaml index 599bcc205d..4fc4767953 100644 --- a/deployment/eks/flyte_helm_dataplane_generated.yaml +++ b/deployment/eks/flyte_helm_dataplane_generated.yaml @@ -94,7 +94,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -427,7 +427,7 @@ spec: template: metadata: annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -453,7 +453,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -507,9 +507,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" spec: securityContext: fsGroup: 65534 @@ -518,7 +518,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -541,7 +541,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/deployment/eks/flyte_helm_generated.yaml b/deployment/eks/flyte_helm_generated.yaml index f7d3831750..1139ce2fbc 100644 --- a/deployment/eks/flyte_helm_generated.yaml +++ b/deployment/eks/flyte_helm_generated.yaml @@ -460,7 +460,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -900,7 +900,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -917,7 +917,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -931,7 +931,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -944,7 +944,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -967,7 +967,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -1068,7 +1068,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -1121,7 +1121,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -1188,7 +1188,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -1202,7 +1202,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -1278,7 +1278,7 @@ spec: - precheck - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler-check volumeMounts: @@ -1294,7 +1294,7 @@ spec: - run - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler ports: @@ -1349,7 +1349,7 @@ spec: template: metadata: annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -1375,7 +1375,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -1429,9 +1429,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "cf10dd496990b00eb78ec87579c9d8f4802b1e4fef25abfa559c778e01e18a3" + configChecksum: "f1e5347cc1810b310fe4e5571a143a29a15cc6685abe43202cc95277f1c5142" spec: securityContext: fsGroup: 65534 @@ -1440,7 +1440,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -1463,7 +1463,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/deployment/gcp/flyte_generated.yaml b/deployment/gcp/flyte_generated.yaml index 68afa9aee7..14897b6b71 100644 --- a/deployment/gcp/flyte_generated.yaml +++ b/deployment/gcp/flyte_generated.yaml @@ -8682,7 +8682,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: cr.flyte.org/flyteorg/datacatalog:v1.0.51 + image: cr.flyte.org/flyteorg/datacatalog:v1.9.37 imagePullPolicy: IfNotPresent name: datacatalog ports: @@ -8705,7 +8705,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: cr.flyte.org/flyteorg/datacatalog:v1.0.51 + image: cr.flyte.org/flyteorg/datacatalog:v1.9.37 imagePullPolicy: IfNotPresent name: run-migrations volumeMounts: @@ -8766,7 +8766,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: cr.flyte.org/flyteorg/flytepropeller:v1.1.116 + image: cr.flyte.org/flyteorg/flytepropeller:v1.9.37 imagePullPolicy: IfNotPresent name: webhook volumeMounts: @@ -8793,7 +8793,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: cr.flyte.org/flyteorg/flytepropeller:v1.1.116 + image: cr.flyte.org/flyteorg/flytepropeller:v1.9.37 imagePullPolicy: IfNotPresent name: generate-secrets volumeMounts: @@ -8841,7 +8841,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: flyteadmin ports: @@ -8888,7 +8888,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: run-migrations volumeMounts: @@ -8905,7 +8905,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: seed-projects volumeMounts: @@ -8919,7 +8919,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: sync-cluster-resources volumeMounts: @@ -8939,7 +8939,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: generate-secrets volumeMounts: @@ -8993,7 +8993,7 @@ spec: - envFrom: - configMapRef: name: flyte-console-config - image: cr.flyte.org/flyteorg/flyteconsole:v1.9.2 + image: cr.flyte.org/flyteorg/flyteconsole:v1.10.2 name: flyteconsole ports: - containerPort: 8080 @@ -9044,7 +9044,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: cr.flyte.org/flyteorg/flytepropeller:v1.1.116 + image: cr.flyte.org/flyteorg/flytepropeller:v1.9.37 imagePullPolicy: IfNotPresent name: flytepropeller ports: @@ -9312,7 +9312,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: cr.flyte.org/flyteorg/flyteadmin:v1.1.118 + image: cr.flyte.org/flyteorg/flyteadmin:v1.9.37 imagePullPolicy: IfNotPresent name: sync-cluster-resources volumeMounts: diff --git a/deployment/gcp/flyte_helm_controlplane_generated.yaml b/deployment/gcp/flyte_helm_controlplane_generated.yaml index 8e7f3fb21f..27d1319bf4 100644 --- a/deployment/gcp/flyte_helm_controlplane_generated.yaml +++ b/deployment/gcp/flyte_helm_controlplane_generated.yaml @@ -590,7 +590,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -607,7 +607,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -621,7 +621,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -634,7 +634,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -657,7 +657,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -758,7 +758,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -811,7 +811,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -878,7 +878,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -892,7 +892,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -968,7 +968,7 @@ spec: - precheck - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler-check volumeMounts: @@ -984,7 +984,7 @@ spec: - run - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler ports: diff --git a/deployment/gcp/flyte_helm_dataplane_generated.yaml b/deployment/gcp/flyte_helm_dataplane_generated.yaml index 14fa2ea685..458d10a150 100644 --- a/deployment/gcp/flyte_helm_dataplane_generated.yaml +++ b/deployment/gcp/flyte_helm_dataplane_generated.yaml @@ -94,7 +94,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -435,7 +435,7 @@ spec: template: metadata: annotations: - configChecksum: "bfaf1bceec4436c35ab0d53e002792acb6640b64badc8a039a2c67ffe8ca88a" + configChecksum: "c73cc0217526d4e3af5eca469c1d9cbedc92d56caddc9e05d926b5cd5b82f26" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -460,7 +460,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -514,9 +514,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "bfaf1bceec4436c35ab0d53e002792acb6640b64badc8a039a2c67ffe8ca88a" + configChecksum: "c73cc0217526d4e3af5eca469c1d9cbedc92d56caddc9e05d926b5cd5b82f26" spec: securityContext: fsGroup: 65534 @@ -525,7 +525,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -548,7 +548,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/deployment/gcp/flyte_helm_generated.yaml b/deployment/gcp/flyte_helm_generated.yaml index 26965f8e59..ac06058686 100644 --- a/deployment/gcp/flyte_helm_generated.yaml +++ b/deployment/gcp/flyte_helm_generated.yaml @@ -473,7 +473,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -923,7 +923,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -940,7 +940,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -954,7 +954,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -967,7 +967,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -990,7 +990,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -1091,7 +1091,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -1144,7 +1144,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -1211,7 +1211,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -1225,7 +1225,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -1301,7 +1301,7 @@ spec: - precheck - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler-check volumeMounts: @@ -1317,7 +1317,7 @@ spec: - run - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler ports: @@ -1372,7 +1372,7 @@ spec: template: metadata: annotations: - configChecksum: "bfaf1bceec4436c35ab0d53e002792acb6640b64badc8a039a2c67ffe8ca88a" + configChecksum: "c73cc0217526d4e3af5eca469c1d9cbedc92d56caddc9e05d926b5cd5b82f26" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -1397,7 +1397,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -1451,9 +1451,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "bfaf1bceec4436c35ab0d53e002792acb6640b64badc8a039a2c67ffe8ca88a" + configChecksum: "c73cc0217526d4e3af5eca469c1d9cbedc92d56caddc9e05d926b5cd5b82f26" spec: securityContext: fsGroup: 65534 @@ -1462,7 +1462,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -1485,7 +1485,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/deployment/sandbox-binary/flyte_sandbox_binary_helm_generated.yaml b/deployment/sandbox-binary/flyte_sandbox_binary_helm_generated.yaml index bb5e0cd675..a72612995d 100644 --- a/deployment/sandbox-binary/flyte_sandbox_binary_helm_generated.yaml +++ b/deployment/sandbox-binary/flyte_sandbox_binary_helm_generated.yaml @@ -116,7 +116,7 @@ data: stackdriver-enabled: false k8s: co-pilot: - image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.4" + image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.37" k8s-array: logs: config: @@ -367,7 +367,7 @@ spec: app.kubernetes.io/instance: flyte app.kubernetes.io/component: flyte-binary annotations: - checksum/configuration: d220769393e7acbe0372fdccbf3d588797864ec934661f08912e88ec084cdfde + checksum/configuration: 8d4b5b042202a25e67ec9999ec2ed9721c6aa893f8c3f9da580de41583ec7c34 checksum/configuration-secret: d5d93f4e67780b21593dc3799f0f6682aab0765e708e4020939975d14d44f929 checksum/cluster-resource-templates: 7dfa59f3d447e9c099b8f8ffad3af466fecbc9cf9f8c97295d9634254a55d4ae spec: diff --git a/deployment/sandbox/flyte_helm_generated.yaml b/deployment/sandbox/flyte_helm_generated.yaml index 5edf240dd7..bd5a1ebf83 100644 --- a/deployment/sandbox/flyte_helm_generated.yaml +++ b/deployment/sandbox/flyte_helm_generated.yaml @@ -585,7 +585,7 @@ data: plugins: k8s: co-pilot: - image: cr.flyte.org/flyteorg/flytecopilot:v1.9.4 + image: cr.flyte.org/flyteorg/flytecopilot:v1.9.37 name: flyte-copilot- start-timeout: 30s core.yaml: | @@ -6712,7 +6712,7 @@ spec: - /etc/flyte/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -6728,7 +6728,7 @@ spec: - flytesnacks - flytetester - flyteexamples - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: seed-projects volumeMounts: @@ -6741,7 +6741,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - sync - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -6753,7 +6753,7 @@ spec: - mountPath: /etc/secrets/ name: admin-secrets - name: generate-secrets - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" command: ["/bin/sh", "-c"] args: @@ -6776,7 +6776,7 @@ spec: - --config - /etc/flyte/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: flyteadmin ports: @@ -6867,7 +6867,7 @@ spec: - /etc/flyte/config/*.yaml - clusterresource - run - image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.4" + image: "cr.flyte.org/flyteorg/flyteadmin:v1.9.37" imagePullPolicy: "IfNotPresent" name: sync-cluster-resources volumeMounts: @@ -6917,7 +6917,7 @@ spec: runAsUser: 1000 fsGroupChangePolicy: "OnRootMismatch" containers: - - image: "cr.flyte.org/flyteorg/flyteconsole:v1.9.6" + - image: "cr.flyte.org/flyteorg/flyteconsole:v1.10.2" imagePullPolicy: "IfNotPresent" name: flyteconsole envFrom: @@ -6982,7 +6982,7 @@ spec: - /etc/datacatalog/config/*.yaml - migrate - run - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: run-migrations volumeMounts: @@ -6995,7 +6995,7 @@ spec: - --config - /etc/datacatalog/config/*.yaml - serve - image: "cr.flyte.org/flyteorg/datacatalog:v1.9.4" + image: "cr.flyte.org/flyteorg/datacatalog:v1.9.37" imagePullPolicy: "IfNotPresent" name: datacatalog ports: @@ -7061,7 +7061,7 @@ spec: - precheck - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler-check volumeMounts: @@ -7076,7 +7076,7 @@ spec: - run - --config - /etc/flyte/config/*.yaml - image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.4" + image: "cr.flyte.org/flyteorg/flytescheduler:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytescheduler ports: @@ -7128,7 +7128,7 @@ spec: template: metadata: annotations: - configChecksum: "c697ea119d64252b05db042d992ae0b97fd1335b20817dff7039e40d507f5b2" + configChecksum: "f74a958b891996826da5178e0000cf337ab40c922346145632a82a4f1e1fdb0" labels: app.kubernetes.io/name: flytepropeller app.kubernetes.io/instance: flyte @@ -7153,7 +7153,7 @@ spec: valueFrom: fieldRef: fieldPath: metadata.namespace - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" name: flytepropeller ports: @@ -7200,9 +7200,9 @@ spec: labels: app: flyte-pod-webhook app.kubernetes.io/name: flyte-pod-webhook - app.kubernetes.io/version: v1.9.4 + app.kubernetes.io/version: v1.9.37 annotations: - configChecksum: "c697ea119d64252b05db042d992ae0b97fd1335b20817dff7039e40d507f5b2" + configChecksum: "f74a958b891996826da5178e0000cf337ab40c922346145632a82a4f1e1fdb0" spec: securityContext: fsGroup: 65534 @@ -7211,7 +7211,7 @@ spec: serviceAccountName: flyte-pod-webhook initContainers: - name: generate-secrets - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller @@ -7234,7 +7234,7 @@ spec: mountPath: /etc/flyte/config containers: - name: webhook - image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.4" + image: "cr.flyte.org/flyteorg/flytepropeller:v1.9.37" imagePullPolicy: "IfNotPresent" command: - flytepropeller diff --git a/docker/sandbox-bundled/manifests/complete-agent.yaml b/docker/sandbox-bundled/manifests/complete-agent.yaml index e537fef738..d9d94e5023 100644 --- a/docker/sandbox-bundled/manifests/complete-agent.yaml +++ b/docker/sandbox-bundled/manifests/complete-agent.yaml @@ -468,7 +468,7 @@ data: stackdriver-enabled: false k8s: co-pilot: - image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.4" + image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.37" k8s-array: logs: config: @@ -816,7 +816,7 @@ type: Opaque --- apiVersion: v1 data: - haSharedSecret: NlhtNUl5amRScVFNVHVPRQ== + haSharedSecret: SWRqSVZmendLdVJvamVGRQ== proxyPassword: "" proxyUsername: "" kind: Secret @@ -1246,7 +1246,7 @@ spec: metadata: annotations: checksum/cluster-resource-templates: 6fd9b172465e3089fcc59f738b92b8dc4d8939360c19de8ee65f68b0e7422035 - checksum/configuration: b765a68950c83acd0c069dac2a6569cf2b0f0f76a2760eea3561d1d04d6be831 + checksum/configuration: b051b935f0b2cf878f2f2f2ed160c017053123ab4d8d46d2214084233a5623c5 checksum/configuration-secret: 09216ffaa3d29e14f88b1f30af580d02a2a5e014de4d750b7f275cc07ed4e914 labels: app.kubernetes.io/component: flyte-binary @@ -1409,7 +1409,7 @@ spec: metadata: annotations: checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81 - checksum/secret: 4816300df83f72e9be3652c291978fb2e05b80b8afcc3dfd6812f4aa28d5f640 + checksum/secret: 4e6248034c039b0bc65cf110d26fccc9d88b8a2d49855a0ecba0443f972ca3c3 labels: app: docker-registry release: flyte-sandbox diff --git a/docker/sandbox-bundled/manifests/complete.yaml b/docker/sandbox-bundled/manifests/complete.yaml index 4893470813..998f71d0a0 100644 --- a/docker/sandbox-bundled/manifests/complete.yaml +++ b/docker/sandbox-bundled/manifests/complete.yaml @@ -457,7 +457,7 @@ data: stackdriver-enabled: false k8s: co-pilot: - image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.4" + image: "cr.flyte.org/flyteorg/flytecopilot:v1.9.37" k8s-array: logs: config: @@ -805,7 +805,7 @@ type: Opaque --- apiVersion: v1 data: - haSharedSecret: dVREVFFlOUx5dWtyRzNhNg== + haSharedSecret: UUREcXo3a1VGNnlyc1RCWg== proxyPassword: "" proxyUsername: "" kind: Secret @@ -1203,7 +1203,7 @@ spec: metadata: annotations: checksum/cluster-resource-templates: 6fd9b172465e3089fcc59f738b92b8dc4d8939360c19de8ee65f68b0e7422035 - checksum/configuration: b765a68950c83acd0c069dac2a6569cf2b0f0f76a2760eea3561d1d04d6be831 + checksum/configuration: b051b935f0b2cf878f2f2f2ed160c017053123ab4d8d46d2214084233a5623c5 checksum/configuration-secret: 09216ffaa3d29e14f88b1f30af580d02a2a5e014de4d750b7f275cc07ed4e914 labels: app.kubernetes.io/component: flyte-binary @@ -1366,7 +1366,7 @@ spec: metadata: annotations: checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81 - checksum/secret: b96da081475b0e9dc4818925c2b987d4a03f4ae8cdd13c5646882144c377d80f + checksum/secret: cfe2089fc583f69d068c3b3d56e875082a5d926c70b00b32f094d587df7396a5 labels: app: docker-registry release: flyte-sandbox diff --git a/docker/sandbox-bundled/manifests/dev.yaml b/docker/sandbox-bundled/manifests/dev.yaml index ede3676233..f88f94fcd3 100644 --- a/docker/sandbox-bundled/manifests/dev.yaml +++ b/docker/sandbox-bundled/manifests/dev.yaml @@ -499,7 +499,7 @@ metadata: --- apiVersion: v1 data: - haSharedSecret: dng0dkhOTDZTYzNVWXQweQ== + haSharedSecret: VjRtTTRpSW94OU9rUVFZTQ== proxyPassword: "" proxyUsername: "" kind: Secret @@ -933,7 +933,7 @@ spec: metadata: annotations: checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81 - checksum/secret: bc60a1502c30ce6508ac0b78e0b15a13e624a5671ca81548f1782cb21e540d58 + checksum/secret: 8b25114d47a69e875e3841dace0b87abfda7a16f6833a5cf76b4570092f3a1cd labels: app: docker-registry release: flyte-sandbox diff --git a/go.mod b/go.mod index 889bfc66ec..bd0f075cc4 100644 --- a/go.mod +++ b/go.mod @@ -3,10 +3,10 @@ module github.com/flyteorg/flyte go 1.19 require ( - github.com/flyteorg/flyte/datacatalog v1.9.4 - github.com/flyteorg/flyte/flyteadmin v1.9.4 - github.com/flyteorg/flyte/flytepropeller v1.9.4 - github.com/flyteorg/flyte/flytestdlib v1.9.4 + github.com/flyteorg/flyte/datacatalog v1.9.37 + github.com/flyteorg/flyte/flyteadmin v1.9.37 + github.com/flyteorg/flyte/flytepropeller v1.9.37 + github.com/flyteorg/flyte/flytestdlib v1.9.37 github.com/golang/glog v1.1.0 github.com/prometheus/client_golang v1.12.1 github.com/spf13/cobra v1.4.0 diff --git a/kustomize/overlays/gcp/kustomization.yaml b/kustomize/overlays/gcp/kustomization.yaml index c6ab14efbd..f264946c08 100644 --- a/kustomize/overlays/gcp/kustomization.yaml +++ b/kustomize/overlays/gcp/kustomization.yaml @@ -23,23 +23,23 @@ bases: images: # FlyteAdmin - name: flyteadmin # match images with this name - newTag: v1.1.118 # FLYTEADMIN_TAG override the tag + newTag: v1.9.37 # FLYTEADMIN_TAG override the tag newName: cr.flyte.org/flyteorg/flyteadmin # override the name # FlyteConsole - name: flyteconsole # match images with this name - newTag: v1.9.2 # FLYTECONSOLE_TAG the tag + newTag: v1.10.2 # FLYTECONSOLE_TAG the tag newName: cr.flyte.org/flyteorg/flyteconsole # override the namep # Flyte DataCatalog - name: datacatalog # match images with this name - newTag: v1.0.51 # DATACATALOG_TAG override the tag + newTag: v1.9.37 # DATACATALOG_TAG override the tag newName: cr.flyte.org/flyteorg/datacatalog # override the name # FlytePropeller - name: flytepropeller # match images with this name - newTag: v1.1.116 # FLYTEPROPELLER_TAG override the tag + newTag: v1.9.37 # FLYTEPROPELLER_TAG override the tag newName: cr.flyte.org/flyteorg/flytepropeller # override the name # Webhook - name: webhook # match images with this name - newTag: v1.1.116 # FLYTEPROPELLER_TAG override the tag + newTag: v1.9.37 # FLYTEPROPELLER_TAG override the tag newName: cr.flyte.org/flyteorg/flytepropeller # override the name # Override postgres image to use alpine based (rather smaller) docker image - name: postgres diff --git a/rsts/conf.py b/rsts/conf.py index 83034d4dce..d958ef1f64 100644 --- a/rsts/conf.py +++ b/rsts/conf.py @@ -30,7 +30,7 @@ # The short X.Y version version = "" # The full version, including alpha/beta/rc tags -release = "1.10.0-b0" +release = "1.10.0" # -- General configuration --------------------------------------------------- diff --git a/rsts/deployment/configuration/generated/flyteadmin_config.rst b/rsts/deployment/configuration/generated/flyteadmin_config.rst index 8b43aa8361..8970bf6e73 100644 --- a/rsts/deployment/configuration/generated/flyteadmin_config.rst +++ b/rsts/deployment/configuration/generated/flyteadmin_config.rst @@ -324,6 +324,18 @@ Command for external authentication token generation [] +proxyCommand ([]string) +------------------------------------------------------------------------------------------------------------------------ + +Command for external proxy-authorization token generation + +**Default Value**: + +.. code-block:: yaml + + [] + + defaultServiceConfig (string) ------------------------------------------------------------------------------------------------------------------------ @@ -671,6 +683,8 @@ Defines Auth options for apps. UserAuth must be enabled for AppAuth to work. baseUrl: "" httpProxyURL: "" metadataUrl: "" + retryAttempts: 5 + retryDelay: 1s selfAuthServer: accessTokenLifespan: 30m0s authorizationCodeLifespan: 5m0s @@ -835,6 +849,8 @@ External Authorization Server config. baseUrl: "" httpProxyURL: "" metadataUrl: "" + retryAttempts: 5 + retryDelay: 1s thirdPartyConfig (`config.ThirdPartyConfigOptions`_) @@ -1052,6 +1068,30 @@ OPTIONAL: HTTP Proxy to be used for OAuth requests. "" +retryAttempts (int) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Optional: The number of attempted retries on a transient failure to get the OAuth metadata + +**Default Value**: + +.. code-block:: yaml + + "5" + + +retryDelay (`config.Duration`_) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Optional, Duration to wait between retries + +**Default Value**: + +.. code-block:: yaml + + 1s + + config.ThirdPartyConfigOptions ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -2460,7 +2500,11 @@ k8s (`config.K8sPluginConfig`_) default-tolerations: null delete-resource-on-finalize: false enable-host-networking-pod: null + gpu-device-node-label: k8s.amazonaws.com/accelerator + gpu-partition-size-node-label: k8s.amazonaws.com/gpu-partition-size gpu-resource-name: nvidia.com/gpu + gpu-unpartitioned-node-selector-requirement: null + gpu-unpartitioned-toleration: null image-pull-backoff-grace-period: 3m0s inject-finalizer: false interruptible-node-selector: null @@ -2469,6 +2513,7 @@ k8s (`config.K8sPluginConfig`_) non-interruptible-node-selector-requirement: null resource-tolerations: null scheduler-name: "" + send-object-events: false catalog.Config @@ -2765,6 +2810,46 @@ image-pull-backoff-grace-period (`config.Duration`_) 3m0s +gpu-device-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/accelerator + + +gpu-partition-size-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/gpu-partition-size + + +gpu-unpartitioned-node-selector-requirement (v1.NodeSelectorRequirement) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + +gpu-unpartitioned-toleration (v1.Toleration) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + gpu-resource-name (string) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" @@ -2839,6 +2924,18 @@ Frequency of resyncing default pod templates 30s +send-object-events (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +If true, will send k8s object events in TaskExecutionEvent updates. + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.FlyteCoPilotConfig ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -3330,7 +3427,9 @@ config for a workflow node node-active-deadline: 0s node-execution-deadline: 0s workflow-active-deadline: 0s - interruptible-failure-threshold: 1 + default-max-attempts: 1 + ignore-retry-cause: false + interruptible-failure-threshold: -1 max-node-retries-system-failures: 3 @@ -3455,6 +3554,18 @@ Enable creation of the FlyteWorkflow CRD on startup "false" +array-node-event-version (int) +------------------------------------------------------------------------------------------------------------------------ + +ArrayNode eventing version. 0 => legacy (drop-in replacement for maptask), 1 => new + +**Default Value**: + +.. code-block:: yaml + + "0" + + config.CompositeQueueConfig ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -3767,10 +3878,22 @@ Maximum number of retries per node for node failure due to infra issues "3" -interruptible-failure-threshold (int64) +interruptible-failure-threshold (int32) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +number of failures for a node to be still considered interruptible. Negative numbers are treated as complementary (ex. -1 means last attempt is non-interruptible).' + +**Default Value**: + +.. code-block:: yaml + + "-1" + + +default-max-attempts (int32) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" -number of failures for a node to be still considered interruptible' +Default maximum number of attempts for a node **Default Value**: @@ -3779,6 +3902,18 @@ number of failures for a node to be still considered interruptible' "1" +ignore-retry-cause (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Ignore retry cause and count all attempts toward a node's max attempts + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.DefaultDeadlines ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -4387,6 +4522,7 @@ grpc (`config.GrpcConfig`_) .. code-block:: yaml + enableGrpcHistograms: false maxMessageSizeBytes: 0 port: 8089 serverReflection: true @@ -4587,6 +4723,18 @@ The max size in bytes for incoming gRPC messages "0" +enableGrpcHistograms (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Enable grpc histograms + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.KubeClientConfig (kubeClientConfig) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ diff --git a/rsts/deployment/configuration/generated/flytepropeller_config.rst b/rsts/deployment/configuration/generated/flytepropeller_config.rst index 25fac2bf1d..3a85329ab3 100644 --- a/rsts/deployment/configuration/generated/flytepropeller_config.rst +++ b/rsts/deployment/configuration/generated/flytepropeller_config.rst @@ -294,6 +294,18 @@ Command for external authentication token generation [] +proxyCommand ([]string) +------------------------------------------------------------------------------------------------------------------------ + +Command for external proxy-authorization token generation + +**Default Value**: + +.. code-block:: yaml + + [] + + defaultServiceConfig (string) ------------------------------------------------------------------------------------------------------------------------ @@ -746,6 +758,9 @@ agent-service (`agent.Config`_) Value: 50 ProjectScopeResourceConstraint: Value: 100 + supportedTaskTypes: + - task_type_1 + - task_type_2 webApi: caching: maxSystemFailures: 5 @@ -931,7 +946,11 @@ k8s (`config.K8sPluginConfig`_) default-tolerations: null delete-resource-on-finalize: false enable-host-networking-pod: null + gpu-device-node-label: k8s.amazonaws.com/accelerator + gpu-partition-size-node-label: k8s.amazonaws.com/gpu-partition-size gpu-resource-name: nvidia.com/gpu + gpu-unpartitioned-node-selector-requirement: null + gpu-unpartitioned-toleration: null image-pull-backoff-grace-period: 3m0s inject-finalizer: false interruptible-node-selector: null @@ -940,6 +959,7 @@ k8s (`config.K8sPluginConfig`_) non-interruptible-node-selector-requirement: null resource-tolerations: null scheduler-name: "" + send-object-events: false k8s-array (`k8s.Config`_) @@ -1286,6 +1306,17 @@ agentForTaskTypes (map[string]string) null +supportedTaskTypes ([]string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + - task_type_1 + - task_type_2 + + agent.Agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -2305,6 +2336,46 @@ image-pull-backoff-grace-period (`config.Duration`_) 3m0s +gpu-device-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/accelerator + + +gpu-partition-size-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/gpu-partition-size + + +gpu-unpartitioned-node-selector-requirement (v1.NodeSelectorRequirement) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + +gpu-unpartitioned-toleration (v1.Toleration) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + gpu-resource-name (string) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" @@ -2379,6 +2450,18 @@ Frequency of resyncing default pod templates 30s +send-object-events (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +If true, will send k8s object events in TaskExecutionEvent updates. + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.FlyteCoPilotConfig ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -4000,7 +4083,9 @@ config for a workflow node node-active-deadline: 0s node-execution-deadline: 0s workflow-active-deadline: 0s - interruptible-failure-threshold: 1 + default-max-attempts: 1 + ignore-retry-cause: false + interruptible-failure-threshold: -1 max-node-retries-system-failures: 3 @@ -4125,6 +4210,18 @@ Enable creation of the FlyteWorkflow CRD on startup "false" +array-node-event-version (int) +------------------------------------------------------------------------------------------------------------------------ + +ArrayNode eventing version. 0 => legacy (drop-in replacement for maptask), 1 => new + +**Default Value**: + +.. code-block:: yaml + + "0" + + admin-launcher (`launchplan.AdminConfig`_) ------------------------------------------------------------------------------------------------------------------------ @@ -4583,10 +4680,22 @@ Maximum number of retries per node for node failure due to infra issues "3" -interruptible-failure-threshold (int64) +interruptible-failure-threshold (int32) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" -number of failures for a node to be still considered interruptible' +number of failures for a node to be still considered interruptible. Negative numbers are treated as complementary (ex. -1 means last attempt is non-interruptible).' + +**Default Value**: + +.. code-block:: yaml + + "-1" + + +default-max-attempts (int32) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Default maximum number of attempts for a node **Default Value**: @@ -4595,6 +4704,18 @@ number of failures for a node to be still considered interruptible' "1" +ignore-retry-cause (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Ignore retry cause and count all attempts toward a node's max attempts + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.DefaultDeadlines ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ diff --git a/rsts/deployment/configuration/generated/scheduler_config.rst b/rsts/deployment/configuration/generated/scheduler_config.rst index 2adc8c61e6..c2ed67edd7 100644 --- a/rsts/deployment/configuration/generated/scheduler_config.rst +++ b/rsts/deployment/configuration/generated/scheduler_config.rst @@ -324,6 +324,18 @@ Command for external authentication token generation [] +proxyCommand ([]string) +------------------------------------------------------------------------------------------------------------------------ + +Command for external proxy-authorization token generation + +**Default Value**: + +.. code-block:: yaml + + [] + + defaultServiceConfig (string) ------------------------------------------------------------------------------------------------------------------------ @@ -671,6 +683,8 @@ Defines Auth options for apps. UserAuth must be enabled for AppAuth to work. baseUrl: "" httpProxyURL: "" metadataUrl: "" + retryAttempts: 5 + retryDelay: 1s selfAuthServer: accessTokenLifespan: 30m0s authorizationCodeLifespan: 5m0s @@ -835,6 +849,8 @@ External Authorization Server config. baseUrl: "" httpProxyURL: "" metadataUrl: "" + retryAttempts: 5 + retryDelay: 1s thirdPartyConfig (`config.ThirdPartyConfigOptions`_) @@ -1052,6 +1068,30 @@ OPTIONAL: HTTP Proxy to be used for OAuth requests. "" +retryAttempts (int) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Optional: The number of attempted retries on a transient failure to get the OAuth metadata + +**Default Value**: + +.. code-block:: yaml + + "5" + + +retryDelay (`config.Duration`_) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Optional, Duration to wait between retries + +**Default Value**: + +.. code-block:: yaml + + 1s + + config.ThirdPartyConfigOptions ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -2460,7 +2500,11 @@ k8s (`config.K8sPluginConfig`_) default-tolerations: null delete-resource-on-finalize: false enable-host-networking-pod: null + gpu-device-node-label: k8s.amazonaws.com/accelerator + gpu-partition-size-node-label: k8s.amazonaws.com/gpu-partition-size gpu-resource-name: nvidia.com/gpu + gpu-unpartitioned-node-selector-requirement: null + gpu-unpartitioned-toleration: null image-pull-backoff-grace-period: 3m0s inject-finalizer: false interruptible-node-selector: null @@ -2469,6 +2513,7 @@ k8s (`config.K8sPluginConfig`_) non-interruptible-node-selector-requirement: null resource-tolerations: null scheduler-name: "" + send-object-events: false catalog.Config @@ -2765,6 +2810,46 @@ image-pull-backoff-grace-period (`config.Duration`_) 3m0s +gpu-device-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/accelerator + + +gpu-partition-size-node-label (string) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + k8s.amazonaws.com/gpu-partition-size + + +gpu-unpartitioned-node-selector-requirement (v1.NodeSelectorRequirement) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + +gpu-unpartitioned-toleration (v1.Toleration) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +**Default Value**: + +.. code-block:: yaml + + null + + gpu-resource-name (string) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" @@ -2839,6 +2924,18 @@ Frequency of resyncing default pod templates 30s +send-object-events (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +If true, will send k8s object events in TaskExecutionEvent updates. + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.FlyteCoPilotConfig ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -3330,7 +3427,9 @@ config for a workflow node node-active-deadline: 0s node-execution-deadline: 0s workflow-active-deadline: 0s - interruptible-failure-threshold: 1 + default-max-attempts: 1 + ignore-retry-cause: false + interruptible-failure-threshold: -1 max-node-retries-system-failures: 3 @@ -3455,6 +3554,18 @@ Enable creation of the FlyteWorkflow CRD on startup "false" +array-node-event-version (int) +------------------------------------------------------------------------------------------------------------------------ + +ArrayNode eventing version. 0 => legacy (drop-in replacement for maptask), 1 => new + +**Default Value**: + +.. code-block:: yaml + + "0" + + config.CompositeQueueConfig ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -3767,10 +3878,22 @@ Maximum number of retries per node for node failure due to infra issues "3" -interruptible-failure-threshold (int64) +interruptible-failure-threshold (int32) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +number of failures for a node to be still considered interruptible. Negative numbers are treated as complementary (ex. -1 means last attempt is non-interruptible).' + +**Default Value**: + +.. code-block:: yaml + + "-1" + + +default-max-attempts (int32) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" -number of failures for a node to be still considered interruptible' +Default maximum number of attempts for a node **Default Value**: @@ -3779,6 +3902,18 @@ number of failures for a node to be still considered interruptible' "1" +ignore-retry-cause (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Ignore retry cause and count all attempts toward a node's max attempts + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.DefaultDeadlines ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -4387,6 +4522,7 @@ grpc (`config.GrpcConfig`_) .. code-block:: yaml + enableGrpcHistograms: false maxMessageSizeBytes: 0 port: 8089 serverReflection: true @@ -4587,6 +4723,18 @@ The max size in bytes for incoming gRPC messages "0" +enableGrpcHistograms (bool) +"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" + +Enable grpc histograms + +**Default Value**: + +.. code-block:: yaml + + "false" + + config.KubeClientConfig (kubeClientConfig) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^