Releases: flyteorg/flyte
Flyte v1.10.7-b1 milestone release
Flyte v1.10.7-b1 Release
Pre-release testing.
Flyte v1.10.7-b0 milestone release
Flyte v1.10.7-b0 Release
Beta release.
Flyte v1.10.6 milestone release
Flyte 1.10.6 Release
Due to a mishap in the move to the monorepo, we ended up generating the git tags between 1.10.1 to 1.10.5, so in order to decrease the confusion we decided to skip those patch versions and go straight to the next available version.
We've shipped a ton of stuff in this patch release, here are some of the highlights.
GPU Accelerators
You'll be able to get more fine-grained in the use GPU Accelerators in your tasks. Here are some examples:
No preference of GPU accelerator to use:
@task(limits=Resources(gpu="1"))
def my_task() -> None:
...
Schedule on a specific GPU accelerator:
from flytekit.extras.accelerators import T4
@task(
limits=Resources(gpu="1"),
accelerator=T4,
)
def my_task() -> None:
...
Schedule on a Multi-instance GPU (MIG) accelerator with no preference of partition size:
from flytekit.extras.accelerators import A100
@task(
limits=Resources(gpu="1"),
accelerator=A100,
)
def my_task() -> None:
...
Schedule on a Multi-instance GPU (MIG) accelerator with a specific partition size:
from flytekit.extras.accelerators import A100
@task(
limits=Resources(gpu="1"),
accelerator=A100.partition_1g_5gb,
)
def my_task() -> None:
...
Schedule on an unpartitioned Multi-instance GPU (MIG) accelerator:
from flytekit.extras.accelerators import A100
@task(
limits=Resources(gpu="1"),
accelerator=A100.unpartitioned,
)
def my_task() -> None:
...
Improved support for Ray logs
#4266 opens the door for RayJob logs to be persisted.
In #4397 we added support for a link to a Ray dashboard to show up in the task card.
Updated grafana dashboards
We updated the official grafana dashboards in #4382.
Support for Azure AD
A new version of our stow fork added support for Azure AD in flyteorg/stow#9.
Full changelog:
- Restructure Flyte releases by @eapolinario in #4304
- Use debian bookworm as single binary base image by @eapolinario in #4311
- Use local version in single-binary by @eapolinario in #4294
- Accessibility for README by @mishmanners in #4322
- Add tests in
flytepropeller/pkg /controller/executors
from 72.3% to 87.3% coverage by @Future-Outlier in #4276 - fix: remove unused setting in deployment charts by @HeetVekariya in #4252
- Document simplified retry behaviour introduced in #3902 by @fg91 in #4022
- Ray logs persistence by @jeevb in #4266
- Not revisiting task nodes and correctly incrementing parallelism by @hamersaw in #4318
- Fix RunPluginEndToEndTest util by @andresgomezfrr in #4342
- Tune sandbox readiness checks to ensure that sandbox is fully accessi… by @jeevb in #4348
- Chore: Ensure Stalebot doesn't close issues we've not yet triaged. by @brndnblck in #4352
- Do not automatically close stale issues by @eapolinario in #4353
- Fix: Set flyteadmin gRPC port to 80 in ingress if using TLS between load balancer and backend by @fg91 in #3964
- Support Databricks WebAPI 2.1 version and Support
existing_cluster_id
andnew_cluster
options to create a Job by @Future-Outlier in #4361 - Fixing caching on maptasks when using partials by @hamersaw in #4344
- Fix read raw limit by @honnix in #4370
- minor fix to eks-starter.yaml by @guyarad in #4337
- Reporting running if the primary container status is not yet reported by @hamersaw in #4339
- completing retries even if minSuccesses are achieved by @hamersaw in #4338
- Add comment to auth scope by @wild-endeavor in #4341
- Update tests by @eapolinario in #4381
- Update order of cluster resources config to work with both uctl and flytectl by @neverett in #4373
- Update tests in single-binary by @eapolinario in #4383
- Passthrough unique node ID in task execution ID for generating log te… by @jeevb in #4380
- Add Sections in the PR Template by @Future-Outlier in #4367
- Update metadata in ArrayNode TaskExecutionEvents by @hamersaw in #4355
- Fixes list formatting in flytepropeller arch docs by @thomasjpfan in #4345
- Update boilerplate end2end tests by @hamersaw in #4393
- Handle all ray job statuses by @EngHabu in #4389
- Relocate sandbox config by @davidmirror-ops in #4385
- Refactor task logs framework by @jeevb in #4396
- Add support for displaying the Ray dashboard when a RayJob is active by @jeevb in #4397
- Disable path filtering for monorepo components by @eapolinario in #4404
- Silence NotFound when get task resource by @honnix in #4388
- adding consoleUrl parameterization based on partition by @lauralindy in #4375
- [Docs] Sensor Agent Doc by @Future-Outlier in #4195
- [flytepropeller] Add Tests in v1alpha.go including
array_test.go
,branch_test.go
,error_test.go
, andiface_test.go
with 0.13% Coverage Improvement by @Future-Outlier in #4234 - Add more context for ray log template links by @jeevb in #4416
- Add ClusterRole config for Ray by @davidmirror-ops in #4405
- Fix and update scripts for generating grafana dashboards by @Tom-Newton in #4382
- Add artifacts branch to publish to buf on push by @squiishyy in #4450
- Add service monitor for flyte admin and propeller service by @vraiyaninv in #4427
- Fix Kubeflow TF Operator
GetTaskPhase
Bug by @Future-Outlier in #4469 - Instrument opentelemetry by @hamersaw in #4357
- Delete the .github folder from each subdirectory by @pingsutw in #4480
- Fix the loop variable scheduler issue by @pmahindrakar-oss in #4468
- Databricks Plugin Setup Doc Enhancement by @Future-Outlier in #4445
- Put ticker back in place in propeller gc by @eapolinario in #4490
- Store failed execution in flyteadmin by @iaroslav-ciupin in #4390
- Moving from flyteadmin - Upgrade coreos/go-oidc to v3 to pickup claims parsing fixes by @eapolinario in #4139
- Bump flyteorg/stow to 0.3.8 by @eapolinario in #4312
- Remove 'needs' from generate_flyte_manifest by @eapolinario in #4495
- Update Flyte components by @flyte-bot in #4302
- Modify how flytecopilot version is parsed from values file by @eapolinario in #4496
- Ignore component tags in goreleaser by @eapolinario in #4497
- Fix indentation of
shell: task
by @eapolinario in #4498 - Implemented simple echo plugin for testing by @hamersaw in #4489
- Correctly handle resource overrides in KF plugins by @jeevb in #4467
- Remove deprecated InjectDecoder by @EngHabu in #4507
- Fix $HOME resolution and webhook namespace by @EngHabu in #4509
- Add note on updating sandbox cluster configuration by @jeevb in #4510
- Add New PR Template by @Future-Outlier in #4512
- [Docs] Databricks Agent Doc by @Future-Outlier in #4008
- Bump version of goreleaser gh action to v5 by @eapolinario in #4519
- Kf operators use
GetReplicaFunc
(Error Handling) by @Future-Outlier in #4471
New Contributors
- @HeetVekariya made their first contribution in #4252
- @andresgomezfrr made their first contribution in #4342
- @brndnblck made their first contribution in #4352
- @guyarad made their first contribution in #4337
- @neverett made their first contribution in #4373
- @thomasjpfan made their first...
Flyte v1.10.6-b0 milestone release
Flyte v1.10.6-b0 Release
Beta release.
Flyte v1.10.0 milestone release
Flyte v1.10.0 Release
This release marks the move to the (monorepo](#4014). From now on the development of backend components is going to be done in the Flyte main repo.
Flyte Agents are also getting a major lift. They are not only more performant, but we're also announcing support for a variety of agents, including Airflow, Memverge, Snowflake, Databricks.
Programmatically consuming inputs and outputs using flyteremote became a lot easier with the introduction of code snippets directly in the UI. For example, notice the small blurbs below inputs and outputs in the side panel:
You'll now be able to use offloaded types in eager workflows.
More ergonomic improvements to pyflyte, including the inclusion of a progress bar, the ability to activate launchplans, and the ability to interact with gate nodes in local executions.
And much more. Here's the exhaustive list of changes:
Flytekit
- Better error messaging for overrides by @kumare3 in flyteorg/flytekit#1807
- Run remote Launchplan from
pyflyte run
by @kumare3 in flyteorg/flytekit#1785 - Add is none function by @pingsutw in flyteorg/flytekit#1757
- Dynamic workflow should not throw nested task warning by @oliverhu in flyteorg/flytekit#1812
- Add a manual image building GH action by @wild-endeavor in flyteorg/flytekit#1816
- Enable Azure Workload Identity for
fsspec
inflytekit
by @fiedlerNr9 in flyteorg/flytekit#1813 - Fix list of annotated structured dataset by @wild-endeavor in flyteorg/flytekit#1817
- Support the flytectl config.yaml admin.clientSecretEnvVar option in flytekit by @chaohengstudent in flyteorg/flytekit#1819
- Async agent delete function for while loop case by @Future-Outlier in flyteorg/flytekit#1802
- fix docs warnings by @samhita-alla in flyteorg/flytekit#1827
- Fix extract_task_module by @pingsutw in flyteorg/flytekit#1829
- Feat: Add type support for pydantic BaseModels by @ArthurBook in flyteorg/flytekit#1660
- Make FlyteRemote example slightly more copy/pastable by @katrogan in flyteorg/flytekit#1830
- Pyflyte meta inputs by @kumare3 in flyteorg/flytekit#1823
- Use mashumaro to serialize/deserialize dataclass by @hhcs9527 in flyteorg/flytekit#1735
- Databricks Agent by @Future-Outlier in flyteorg/flytekit#1797
- Prometheus metrics by @pingsutw in flyteorg/flytekit#1815
- Pyflyte register optionally activates schedule by @kumare3 in flyteorg/flytekit#1832
- Remove versions 3.9 and 3.10 by @wild-endeavor in flyteorg/flytekit#1831
- Snowflake agent by @hhcs9527 in flyteorg/flytekit#1799
- Update agent metric name by @pingsutw in flyteorg/flytekit#1835
- MemVerge MMCloud Agent by @edwinyyyu in flyteorg/flytekit#1821
- Add download badges to the readme by @pingsutw in flyteorg/flytekit#1836
- Eager local entrypoint and support for offloaded types by @cosmicBboy in flyteorg/flytekit#1833
- update requirements and add snowflake agent to api reference by @samhita-alla in flyteorg/flytekit#1838
- Fix: Make sure decks created in elastic task workers are transferred to parent process by @fg91 in flyteorg/flytekit#1837
- add accept grpc by @wild-endeavor in flyteorg/flytekit#1841
- Feat: Enable
flytekit
to authenticate with proxy in front of FlyteAdmin by @fg91 in flyteorg/flytekit#1787 - Backfill command now supports failure-policy by @kumare3 in flyteorg/flytekit#1840
- Pass cluster pool when creating executions by @iaroslav-ciupin in flyteorg/flytekit#1208
- Add more clear error message when fetching secrets by @ysysys3074 in flyteorg/flytekit#1847
- Pyflyte run workflows correctly handles Optional[TYPE] = None by @cosmicBboy in flyteorg/flytekit#1849
- Bump gitpython from 3.1.32 to 3.1.35 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1828
- Bump cryptography from 41.0.3 to 41.0.4 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1844
- update codecov config in pythonbuild ci by @cosmicBboy in flyteorg/flytekit#1852
- Improved gate node handling by @kumare3 in flyteorg/flytekit#1850
- update codecov yaml, make eager wf test more stable by @cosmicBboy in flyteorg/flytekit#1854
- more codecov updates by @cosmicBboy in flyteorg/flytekit#1856
- make mlflow plugin work with python 3.11 by @bcvanmeurs in flyteorg/flytekit#1855
- Agent get secret function by @Future-Outlier in flyteorg/flytekit#1851
- Better Azure blob storage support by @Tom-Newton in flyteorg/flytekit#1842
- Remove Envd from dockerfile by @pingsutw in flyteorg/flytekit#1814
- Update agent uri format by @hhcs9527 in flyteorg/flytekit#1861
- modified setup.py in flytekit-mmcloud by @helenzhangyc in flyteorg/flytekit#1864
- Label request_failure metric with error_code by @pingsutw in flyteorg/flytekit#1862
- add back Edwin's name by @helenzhangyc in flyteorg/flytekit#1868
- Fix py38 aync agent service and add async agent test by @Future-Outlier in flyteorg/flytekit#1866
- Pin because not installing by @wild-endeavor in flyteorg/flytekit#1872
- Bump pillow from 10.0.0 to 10.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1867
- Prune hosted github runner to free up space for sandbox by @jeevb in flyteorg/flytekit#1875
- Fixes Auth issue, where refresh token is expired by @kumare3 in flyteorg/flytekit#1873
- Name field is incorrect assigned by @kumare3 in flyteorg/flytekit#1874
- [Docs]Updated examples for customizing resources by @LunarMarathon in flyteorg/flytekit#1871
- change key path to SNOWFLAKE_PRIVATE_KEY by @hhcs9527 in flyteorg/flytekit#1879
- Run notebook task on aws batch by @pingsutw in flyteorg/flytekit#1859
- Automatically Convert
name
Argument andregistry
Argument to Lowercase in ImageSpec by @Future-Outlier in flyteorg/flytekit#1881 - Dep: Pin min required flytekit version in IAP plugin by @fg91 in flyteorg/flytekit#1878
- Remove duplicate click option by @wild-endeavor in flyteorg/flytekit#1883
- Bump urllib3 from 1.26.16 to 1.26.17 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1865
- Improve error message in ListTransformer when not passing a list by @fg91 in flyteorg/flytekit#1882
- Update
typing_extension
Any import to typing due totyping_extension
version compatibility by @hfurkanvural in flyteorg/flytekit#1877 - Bump gitpython from 3.1.35 to 3.1.37 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1885
- Airflow agent by @pingsutw in flyteorg/flytekit#1725
- Add mmcloud plugin into the agent image by @pingsutw in flyteorg/flytekit#1891
- Fix map_task sensitive to argument order by @chaohengstudent in flyteorg/flytekit#1888
- Add enable_deck to task decorator by @eapolinario in flyteorg/flytekit#1898
- Add image transformer by @pingsutw in flyteorg/flytekit#1901
- add default project domain in execute launch plan by @troychiu in flyteorg/flytekit#1894
- Add Databricks and Snowflake agent to Dockerfile by @Future-Outlier in flyteorg/flytekit#1905
- Fix module loading bug in instance tracker class by @cosmicBboy in flyteorg/flytekit#1902
Flyteadmin
- Fixed bug for incorrect name (#4175)
- Add version control for ArrayNode eventing (#4165)
- Update golang experimental dep (#4177)
- Add Additional gRPC service handler hook (#4171)
- Handle batched TaskExecutionEvent reasons (#615)
- Lint flyteadmin/auth/handlers_test.go
- #patch Update FromWorkflowModel API (#617)
- add codespell: config, workflow and have typos fixed (#4054)
- Handle batched TaskExecutionEvent reasons (#615)
- Update FromWorkflowModel API (#617)
- Update boilerplate version (#605)
- Reduce a warning to info (#612)
- Logout hook plugin (#611)
- Expire flyte_idt cookie at logout (#610)
- Use configured domain on expired cookie...
Flyte v1.9.1 milestone release
Flyte v1.9.1 Patch Release
Change routing in single binary.
#3978
Flyte v1.9.0 milestone release
Flyte v1.9.0 Release
In this release we're announcing two experimental features, namely (1) ArrayNode map tasks, and (2) Execution Tags.
ArrayNode map tasks
ArrayNodes are described more fully in RFC 3346, but the summary is that ArrayNode map tasks are a drop-in replacement for regular map tasks, the only difference being the submodule used to import the map_task
function.
More explicitly, let's say you have this code:
from typing import List
from flytekit import map_task, task, workflow
@task
def t(a: int) -> int:
...
@workflow
def wf(xs: List[int]) -> List[int]:
return map_task(t)(a=xs)
In order to switch to using array node map tasks you should import map_task from the flytekit.experimental
module like so:
from typing import List
from flytekit import task, workflow
from flytekit.experimental import map_task
@task
def t(a: int) -> int:
...
@workflow
def wf(xs: List[int]) -> List[int]:
return map_task(t)(a=xs)
Execution tags
Execution tags allow users to can discover their executions and other flyte entities more easily, by creating smarter groupings. The feature is described in this RFC.
As mentioned before, this feature is shipped in an experimental capacity, the idea being that we're going to incorporate the feedback of the community as we iterate. More work is expected to give prominence to the feature in flyteconsole, in the meanwhile, the feature is supported via Remote.
Flytekit
- Improve error handling in ShellTask by @pradithya in flyteorg/flytekit#1732
- use default settings for timeline deck width by @cosmicBboy in flyteorg/flytekit#1748
- Raise an exception in case of local execution of raw containers tasks by @eapolinario in flyteorg/flytekit#1745
- Update contributing.rst by @eapolinario in flyteorg/flytekit#1753
- Skip problematic pyyaml versions by @eapolinario in flyteorg/flytekit#1752
- Fail CI tests faster by @eapolinario in flyteorg/flytekit#1756
- Run unit tests on macos-latest by @eapolinario in flyteorg/flytekit#1749
- add rdzv_configs to kfpytorch elastic by @Nan2018 in flyteorg/flytekit#1751
- Fix: Disable rich logging handler when env var
FLYTE_SDK_RICH_TRACEBACKS=0
is set by @fg91 in flyteorg/flytekit#1760 - Throw warning for nested @task functions by @oliverhu in flyteorg/flytekit#1727
- Remove dependency on responses by @honnix in flyteorg/flytekit#1762
- Fix mlflow test error by @pingsutw in flyteorg/flytekit#1766
- Use phrase 'git revision SHA1' in comments and docs by @DavidMertz in flyteorg/flytekit#1761
- Dockerize docs requirements generation by @eapolinario in flyteorg/flytekit#1764
- Restrict grpcio<1.53.1 by @eapolinario in flyteorg/flytekit#1767
- Array node map task by @eapolinario in flyteorg/flytekit#1640
- Add agent ctrl-c handler to call the delete function. (Reupload) by @Future-Outlier in flyteorg/flytekit#1782
- Add tags to execution by @pingsutw in flyteorg/flytekit#1723
Flyteadmin
- Alter ID sequence to bigint by @honnix in flyteorg/flyteadmin#578
- Remove content md5 requirement by @wild-endeavor in flyteorg/flyteadmin#587
- Propagate request id on incoming and outgoing requests by @EngHabu in flyteorg/flyteadmin#582
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#589
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#594
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#596
- Bumping flytestdlib by @gvashishtha in flyteorg/flyteadmin#597
- Flyte Execution tags by @pingsutw in flyteorg/flyteadmin#571
Flyteplugins
- Add support for using task execution ID fields in log URI templates by @jeevb in flyteorg/flyteplugins#372
- Fix generate check in CI by @jeevb in flyteorg/flyteplugins#377
- Remove welcomebot from boilerplate by @eapolinario in flyteorg/flyteplugins#375
- Carry over hash value for all literal types in remote caching by @nicholasjng in flyteorg/flyteplugins#378
- Send task execution metadata to out-core plugin by @honnix in flyteorg/flyteplugins#369
- Support gRPC config for agent-service plugin by @honnix in flyteorg/flyteplugins#368
- Use agent as name where it fits by @honnix in flyteorg/flyteplugins#381
- Fix deletion of elastic task resource requests by @fg91 in flyteorg/flyteplugins#379
Flytepropeller
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#591
- fixing max parallelism by @hamersaw in flyteorg/flytepropeller#594
- Updated flytestdlib 1.0.20 by @hamersaw in flyteorg/flytepropeller#593
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#597
- Instrument ArrayNode by @hamersaw in flyteorg/flytepropeller#550
- make singular unions castable to their underlying type by @hamersaw in flyteorg/flytepropeller#599
- correct propagation of launchplan start error by @hamersaw in flyteorg/flytepropeller#598
- Bumping flytestdlib and stow versions by @gvashishtha in flyteorg/flytepropeller#602
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#601
- Bump flyteplugins to 1.1.15 by @eapolinario in flyteorg/flytepropeller#603
- updated flyteplugins to 1.1.16 by @hamersaw in flyteorg/flytepropeller#604
Flyteconsole
- feat: Add localStorage for selected Project/Domain by @jsonporter in flyteorg/flyteconsole#774
- Fix project selector failing test by @FrankFlitton in flyteorg/flyteconsole#780
- fix: node executions list going blank by @ursucarina in flyteorg/flyteconsole#788
- fix: launch form fixes by @ursucarina in flyteorg/flyteconsole#785
- chore: fix 404 due to bad state by @ursucarina in flyteorg/flyteconsole#797
- Fix: Launch Form fixes by @ursucarina in flyteorg/flyteconsole#798
- fix: map tasks should report caching status accurately by @ursucarina in flyteorg/flyteconsole#800
- feat: add support from structured datasets by @ursucarina in flyteorg/flyteconsole#801
- Top level masonry refactor by @FrankFlitton in flyteorg/flyteconsole#771
- fix: Tasks status out of sync by @ursucarina in flyteorg/flyteconsole#802
- chore: fix test_coverage by @ursucarina in flyteorg/flyteconsole#803
- Fix: breadcrumb feature flag priority order by @FrankFlitton in flyteorg/flyteconsole#804
- chore: fix yarn.lock by @ursucarina in flyteorg/flyteconsole#805
- fix: releases by @ursucarina in flyteorg/flyteconsole#806
- chore: fix release retry by @ursucarina in flyteorg/flyteconsole#807
- fix: specify node18, semantic release with exec and git plugins by @FrankFlitton in flyteorg/flyteconsole#808
- fix: commit linter running on generated messages by @FrankFlitton in flyteorg/flyteconsole#810
- chore: remove release git step by @FrankFlitton in flyteorg/flyteconsole#811
- fix: union value handling in launch form by @ursucarina in flyteorg/flyteconsole#812
New Contributors
- @Nan2018 made their first contribution in flyteorg/flytekit#1751
- @oliverhu made their first contribution in flyteorg/flytekit#1727
- @DavidMertz made their first contribution in flyteorg/flytekit#1761
- @Future-Outlier made their first contribution in flyteorg/flytekit#1782
- @gvashishtha made their first contribution in flyteorg/flyteadmin#597
- @nicholasjng made their first contribution in flyteorg/flyteplugins#378
- @gvashishtha made their first contribution in flyteorg/flytepropeller#602
Flyte v1.8.1 milestone release
Flyte v1.8.1 Patch
Flyte Console
https://github.com/flyteorg/flyteconsole/releases/tag/v1.8.6
https://github.com/flyteorg/flyteconsole/releases/tag/v1.8.7
Full Changelog: flyteorg/flyteconsole@v1.8.5...v1.8.7
Flyte v1.8.0 milestone release
Flyte v1.8.0 Release
Flytekit
- Support configuring pip index url with the image spec by @yini7777 in flyteorg/flytekit#1692
- Improve error message for pyflyte-fast-execute by @pingsutw in flyteorg/flytekit#1686
- Feat: Allow disabling rich tracebacks via env var by @fg91 in flyteorg/flytekit#1695
- Fix task type version in pytorch and mpi task plugin by @yubofredwang in flyteorg/flytekit#1690
- get_transformer returns pickle transformer if type is unsupported by @pingsutw in flyteorg/flytekit#1694
- Add Cuda to ImageSpec by @pingsutw in flyteorg/flytekit#1688
- Feat: Warn when doing local torch elastic training with nnodes > 1 by @fg91 in flyteorg/flytekit#1697
- Fix config of user facing execution parameters in spawning elastic tasks by @fg91 in flyteorg/flytekit#1677
- Union | optional return types supported by @kumare3 in flyteorg/flytekit#1703
- Fail registration if output isn't Optional when using map tasks with min_success_ratio < 1 by @pingsutw in flyteorg/flytekit#1709
- Add bigquery project and location to metadata by @pingsutw in flyteorg/flytekit#1702
- Generate decks at local execution by @pingsutw in flyteorg/flytekit#1699
- Improve task type hint by @pingsutw in flyteorg/flytekit#1711
- Detect upstream nodes from container nested promises by @wild-endeavor in flyteorg/flytekit#1707
- Add Iterator Transformer by @pingsutw in flyteorg/flytekit#1710
- Always a default image and streamline image handling serialize vs package by @wild-endeavor in flyteorg/flytekit#1610
- Remove ensure literal by @wild-endeavor in flyteorg/flytekit#1706
- Fix a bug in gx integration by @XinEDprob in flyteorg/flytekit#1675
- Update pythonbuild.yml: add hugging face plugin to CI by @cosmicBboy in flyteorg/flytekit#1684
- add imagespec cache by @RichhLi in flyteorg/flytekit#1717
- Add requirements to imageSpec by @pingsutw in flyteorg/flytekit#1698
- Memory reduction change by @wild-endeavor in flyteorg/flytekit#1716
- use getattr to access task_def.disable_deck in entrypoint by @cosmicBboy in flyteorg/flytekit#1724
- Add a couple tests by @wild-endeavor in flyteorg/flytekit#1722
- Csvtransform by @ChungYujoyce in flyteorg/flytekit#1671
Flyteadmin
- Add a user-specifiable root to upload link request by @wild-endeavor in flyteorg/flyteadmin#577
- Bump propeller version by @pingsutw in flyteorg/flyteadmin#580
- Upgrade go 1.19 in Dockerfile by @hamersaw in flyteorg/flyteadmin#581
Flytepropeller
- Update flyteplugins to v1.0.67 by @bstadlbauer in flyteorg/flytepropeller#575
- Correctly validating error code on aborting terminal launchplans by @hamersaw in flyteorg/flytepropeller#574
- Use GetExecutionData instead by @EngHabu in flyteorg/flytepropeller#573
- Propagating environment variables through launchplans by @hamersaw in flyteorg/flytepropeller#576
- upgrade dockerfile go to 1.19 by @hamersaw in flyteorg/flytepropeller#580
- Bump flyteplugins version by @pingsutw in flyteorg/flytepropeller#581
- Support for cross-project secrets for GCP by @jeevb in flyteorg/flytepropeller#582
- Added IsFailurePermanent flag on DynamicTaskStatus by @hamersaw in flyteorg/flytepropeller#567
Flyteplugins
- Don't add master replica log link when doing elastic pytorch training by @fg91 in flyteorg/flyteplugins#356
- [Bigquery] Add support for impersonation of GSA bound to task's KSA by @jeevb in flyteorg/flyteplugins#355
- Fix initial dask job state by @bstadlbauer in flyteorg/flyteplugins#357
- Feat: Add pod start and finish time in RFC3339 time format to logging link templating variables #minor by @fg91 in flyteorg/flyteplugins#360
- fix v1 pytorch job plugin with elastic policy by @yubofredwang in flyteorg/flyteplugins#359
- Allow using pod start time in kubeflow plugin log links by @fg91 in flyteorg/flyteplugins#362
- Pass location to the BigQuery request by @pingsutw in flyteorg/flyteplugins#365
- Fix map task cache misses by @bstadlbauer in flyteorg/flyteplugins#363
- Switch to official dask operator by @bstadlbauer in flyteorg/flyteplugins#366
- Fix duplicate env vars in container by @hamersaw in flyteorg/flyteplugins#358
- Set scheduler restart policy to Always by @bstadlbauer in flyteorg/flyteplugins#367
Flyteconsole
- Fix launch plan icon flyteorg/flyteconsole#777
Flyte v1.7.0 milestone release
Flyte v1.7.0 release
In this release we're announcing support for Flyte Agents, a new way of writing backend plugins, only now with a much more tightly integrated developer experience. Also lots of bug fixes all around in a buch of first-time contributors.
Flytekit
- FLYTECTL_CONFIG env var should take highest precedence in flyteorg/flytekit#1662 by @wild-endeavor
- Change flytekit Pytorch, TFJob and MPI plugins to use new kubeflow config in flyteorg/flytekit#1627 by @yubofredwang
- Root cert should be byte string when loading from caCertFilePath in flyteorg/flytekit#1669 by @wild-endeavor
- Explicitly set the content type for flyte deck by in flyteorg/flytekit#1658 @pingsutw
- Set a less strict deadline for hypothesis tests in flyteorg/flytekit#1682 by @eapolinario
- Dep: Use protos of new
kubeflow.pytorch
plugin instead of legacypytorch
plugin in flyteorg/flytekit#1678 by @fg91 - More time info for time line deck in flyteorg/flytekit#1680 by @Yicheng-Lu-llll
Flyteadmin
- Add logs and stats to sync loop in flyteorg/flyteadmin#573 by Haytham Abuelfutuh
- Fix utf-8 encoding issues with trimmed error messages in flyteorg/flyteadmin#569 by Katrina Rogan
- Tiny url improvements in flyteorg/flyteadmin#565 by Yee Hing Tong
- Update startedAt timestamp only if not set in flyteorg/flyteadmin#567 pmahindrakar-oss
- Save execution namespace in system metadata in flyteorg/flyteadmin#568 by Katrina Rogan
Flyteconsole
- fix: navlink in flyteorg/flyteconsole#772 by 4nalog
- fix: bump version for console in flyteorg/flyteconsole#769 by 4nalog
- fix: preserve domain when navigating using sidebar in flyteorg/flyteconsole#768 by 4nalog
- fix: dynamic-node-tasks in flyteorg/flyteconsole#765 by 4nalog
- chore: hide map task runtime info in https://github.com/flyteorg/flyteconsole7/66 by Carina Ursu
- Bug: union val missing for LP relaunch in flyteorg/flyteconsole#762 by Frank Flitton
- Feature: Fullview Flyte Deck modal in flyteorg/flyteconsole#764 by Frank Flitton
- chore: add item when mapped task in flyteorg/flyteconsole#761 by Jason Porter
- Bug: Execution Page's back button returns Workflows route from Launch Plan route https://github.com/flyteorg/flyteconsolepatch in flyteorg/flyteconsole#760 by Frank Flitton
Flytepropeller
- Register gRPC plugin after reading configmap in flyteorg/flytepropeller#564 by Kevin Su
- Not stripping structure from literal types in flyteorg/flytepropeller#571 by Dan Rammer
- Bump flyteplugins to v1.0.63 in flyteorg/flytepropeller#568 by bstadlbauer
- bumped flyteplugins in flyteorg/flytepropeller#566 by Dan Rammer
- Use correct k8 client in flyteorg/flytepropeller#563 by sonjaer