kubeflow#10442)

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

PiperOrigin-RevId: 607802006

…P SDK 2.7.0

PiperOrigin-RevId: 608646229

…flow#9678 (kubeflow#10459)

Signed-off-by: hbelmiro <[email protected]>

PiperOrigin-RevId: 608740017

PiperOrigin-RevId: 609081795

PiperOrigin-RevId: 609107204

…e component

PiperOrigin-RevId: 609129336

PiperOrigin-RevId: 609459972

… tolerations (kubeflow#10471)

* feat(Backend + SDK): Update kfp backend and kubernetes sdk to support tolerations

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

* Address PR review 1

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

* Refactor add_toleration to use Python primitives

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

* Update go.mod to pull in latest kubernetes_platform package

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

---------

Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: edmondop <[email protected]>
Co-authored-by: tarat44 <[email protected]>

PiperOrigin-RevId: 609560776

PiperOrigin-RevId: 609757226

PiperOrigin-RevId: 609832020

… ConfigMaps as volumes and as env variables (kubeflow#10483)

* Update kfp backend and kubernetes sdk to support ConfigMaps as volumes and as env

Signed-off-by: Alexey Roytman <[email protected]>

* update go.mod, apiserver.csv and driver.csv

Signed-off-by: Alexey Roytman <[email protected]>

* add test/snapshot/data files

Signed-off-by: Alexey Roytman <[email protected]>

* fix tests

Signed-off-by: Alexey Roytman <[email protected]>

* go mod tidy

Signed-off-by: Alexey Roytman <[email protected]>

* update backend/third_party_licenses/apiserver.csv

Signed-off-by: Alexey Roytman <[email protected]>

* update backend/third_party_licenses/apiserver.csv

Signed-off-by: Alexey Roytman <[email protected]>

* fix comments

Signed-off-by: Alexey Roytman <[email protected]>

* fix comments

Signed-off-by: Alexey Roytman <[email protected]>

* update go.mod, apiserver.csv and driver.csv

Signed-off-by: Alexey Roytman <[email protected]>

---------

Signed-off-by: Alexey Roytman <[email protected]>

PiperOrigin-RevId: 610830518

…ng. (kubeflow#10494)

* fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling.

* fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling.

* update PR number in release notes

* formatting

* Add compiler_test.py test for single param compile failure

* Update some docstrings and add todo

* formatting

* Update sdk/python/kfp/compiler/compiler_test.py

Co-authored-by: Connor McCarthy <[email protected]>

* Update sdk/python/kfp/compiler/compiler_test.py

Co-authored-by: Connor McCarthy <[email protected]>

* Update sdk/python/kfp/dsl/for_loop.py

Co-authored-by: Connor McCarthy <[email protected]>

* Use print_and_return and other small changes

* typo

* typo

---------

Co-authored-by: Connor McCarthy <[email protected]>

…ter RLHF tuning

PiperOrigin-RevId: 610918020

)

* .

* formatting

…_rubric

PiperOrigin-RevId: 611161020

…n Eval pipeline and components to e2-standard-4

PiperOrigin-RevId: 612531671

PiperOrigin-RevId: 612553652

…eldPath as env (kubeflow#10496)

Signed-off-by: Tommy Li <[email protected]>

…lines

PiperOrigin-RevId: 612662160

…low#10501)

* Updated legal info due to migration from CLA to DCO

Signed-off-by: hbelmiro <[email protected]>

* Updated DCO link

Signed-off-by: hbelmiro <[email protected]>

---------

Signed-off-by: hbelmiro <[email protected]>

…pec (kubeflow#10481)

* Add backend and sdk support for pod spec timeout

Signed-off-by: Tommy Li <[email protected]>

* fix conflicts

Signed-off-by: Tommy Li <[email protected]>

---------

Signed-off-by: Tommy Li <[email protected]>

… the classes which are not predicted in bp outputs

PiperOrigin-RevId: 612920651

PiperOrigin-RevId: 612956960

… ImagePullPolicy (kubeflow#10417)

* feat(Backend + SDK): Update kfp backend and kubernetes sdk to support ImagePullPolicy.

Signed-off-by: Revital Sur <[email protected]>

* Fix format.

Signed-off-by: Revital Sur <[email protected]>

* Update apiserver.csv.

Signed-off-by: Revital Sur <[email protected]>

* Update licenses.

Signed-off-by: Revital Sur <[email protected]>

---------

Signed-off-by: Revital Sur <[email protected]>

…s rendering

PiperOrigin-RevId: 612985431

… training. With the train time eval dataset available, the pipeline outputs the accuracy and cross entropy metrics to the log

PiperOrigin-RevId: 613057150

* Updated output_a_directory.py to V2

* Update output_a_directory_test.py to V2

* Update parallel_join.py to V2

* Update multiple_outputs.ipynb to V2

* Update multiple_outputs_test.py to V2

* Updated kfp_env_validation to V2

* Updated loop_parallelism to V2

…rlhf_pipeline`

PiperOrigin-RevId: 613366137

* upgrade go version to 1.21

Signed-off-by: Tommy Li <[email protected]>

* upgrade integration test to go 1.21

Signed-off-by: Tommy Li <[email protected]>

* refresh go mod tidy

Signed-off-by: Tommy Li <[email protected]>

* fix license

Signed-off-by: Tommy Li <[email protected]>

* update go-sqlite3 to v1.14.19 to support go 1.21 on cache server

Signed-off-by: Tommy Li <[email protected]>

* downgrade go version to 1.20 and revert dockerfile upgrade

Signed-off-by: Tommy Li <[email protected]>

---------

Signed-off-by: Tommy Li <[email protected]>

PiperOrigin-RevId: 614771557

PiperOrigin-RevId: 614785091

… duplicate pipeline [Fixes  kubeflow#10311] (kubeflow#10546)

Validate the error code of pipeline creation in order to return
the status conflict when the error represents AlreadyExists.

Signed-off-by: champon1020 <[email protected]>

daysUntilClose is set to 90 days. This is too much for an issue to keep opened as there is daysUntilStale set to 90 days.
That would keep an issue opened for 6 months, and now there are +600 issues opened in the repository.

We need to start working on keeping the repository healthy.

Signed-off-by: Ricardo M. Oliveira <[email protected]>

…nfigMapAsVolume. Fixes kubeflow#10548 (kubeflow#10549)

* fix(kubernetes_platform): Add optional field to SecretAsVolume and ConfigMapAsVolume.

Signed-off-by: Revital Sur <[email protected]>

* Update comment.

Signed-off-by: Revital Sur <[email protected]>

---------

Signed-off-by: Revital Sur <[email protected]>

PiperOrigin-RevId: 615498240

PiperOrigin-RevId: 615562899

…omponent for vulnerability patch

PiperOrigin-RevId: 615593420

Signed-off-by: Chen Sun <[email protected]>

…o support creating ModelEvaluations as part of the AutoSxS Metrics component

PiperOrigin-RevId: 615675169

PiperOrigin-RevId: 615914679

PiperOrigin-RevId: 616229944

This reverts commit 4d90770.

PiperOrigin-RevId: 616240307

…ines (kubeflow#9876)

* Update resource_spec, retry, secret samples to v2 pipelines

* Update resource_spec, retry, secret samples to v2 pipelines

Signed-off-by: Achyut Madhusudan <[email protected]>

PiperOrigin-RevId: 616895855

Signed-off-by: Chen Sun <[email protected]>

…ns (kubeflow#10577)

Signed-off-by: connor-mccarthy <[email protected]>

…inputs for rlhf

PiperOrigin-RevId: 617285265

PiperOrigin-RevId: 617287233

PiperOrigin-RevId: 617579452

Signed-off-by: Chen Sun <[email protected]>

…ction_based

PiperOrigin-RevId: 617802429

…files. (kubeflow#10591)

Signed-off-by: Achyut Madhusudan <[email protected]>

…vak pipelines from preview to v1

PiperOrigin-RevId: 618017914

PiperOrigin-RevId: 618313694

…peline` in real time

PiperOrigin-RevId: 618924675

…nclude generic ephemerl volume (kubeflow#10602)

* feat(kubernetes_platform): Update kubernetes_platform go package to include Generic Ephemeral Volume resources
Signed-off-by: abaland <[email protected]>

* feat(kubernetes_platform): Update kubernetes_platform go package to include Generic Ephemeral Volume resources (include metadata)
Signed-off-by: abaland <[email protected]>

…flow#10589)

Signed-off-by: Rentaro Matsukata <[email protected]>

…ased

PiperOrigin-RevId: 619026115

Signed-off-by: Ricardo M. Oliveira <[email protected]>

…nclude node affinities and pod (anti)affinities (kubeflow#10583)

* feat(kubernetes_platform): Update kubernetes_platform go package to include nodeaffinities and pod (anti)affinities

Signed-off-by: Cornelis Boon <[email protected]>

* rename affinity objects and fields to match k8s spec semantics

Signed-off-by: Cornelis Boon <[email protected]>

* rename *AffinityRule -> *AffinityTerm and add missing affinity data

Signed-off-by: Cornelis Boon <[email protected]>

---------

Signed-off-by: Cornelis Boon <[email protected]>

…elines

PiperOrigin-RevId: 619378459

…rboard_id` is provided

PiperOrigin-RevId: 619646459

PiperOrigin-RevId: 619665186

…model if user uploaded model is non-tuned

PiperOrigin-RevId: 619714978

PiperOrigin-RevId: 619744783

PiperOrigin-RevId: 619748191

PiperOrigin-RevId: 619982662

PiperOrigin-RevId: 619990671

…ent (kubeflow#10637)

Signed-off-by: tomcli <[email protected]>

…f_pipeline

PiperOrigin-RevId: 620516628

PiperOrigin-RevId: 620699930

PiperOrigin-RevId: 620855438

PiperOrigin-RevId: 621215497

Signed-off-by: tomcli <[email protected]>

…pdated API Service Params (kubeflow#10640)

* fix(backend): Refactor backend common code to use updated API Service Params

Signed-off-by: Giulio Frasca <[email protected]>

* fix(backend): Fix Backend int tests to use updated API Service Params

Signed-off-by: Giulio Frasca <[email protected]>

* WIP: fix(backend): Manually correct the proto schemes to include https

- **NOTE**: this was manually updated, tested, and verified locally
            uploading for CI check
- It appears when regenerating the backend API, something in the
  generation libraries changed and now default the scheme to just
  http, not http+https, which appears to break tests.
- Need to figure out what options to provide api generators to revert
  DefaultScheme to include https again automatically

Signed-off-by: Giulio Frasca <[email protected]>

* chore: Update small syntax change in SWF expected test result check

Signed-off-by: Giulio Frasca <[email protected]>

* chore: Update backend .proto files to include http and https scheme

Signed-off-by: Giulio Frasca <[email protected]>

---------

Signed-off-by: Giulio Frasca <[email protected]>

kubeflow#10550)

* fix(Backend + SDK): Add missing optional field to SecretAsVolume and ConfigMapAsVolume.

Signed-off-by: Revital Sur <[email protected]>

* Update after rebase.

Signed-off-by: Revital Sur <[email protected]>

* Update after rebase.

Signed-off-by: Revital Sur <[email protected]>

* Update after merge.

Signed-off-by: Revital Sur <[email protected]>

* Updates after merge with master branch.

Signed-off-by: Revital Sur <[email protected]>

---------

Signed-off-by: Revital Sur <[email protected]>

…rt of kubeflow#10053 (kubeflow#10087)

* refactor ml-pipeline component for kustomize5 compatibility

Signed-off-by: Alin Spinu <[email protected]>

* rm bk folder

Signed-off-by: Alin Spinu <[email protected]>

* fix kustomizations using auto kustomize edit

Signed-off-by: Alin Spinu <[email protected]>

* fix env/aws

Signed-off-by: Alin Spinu <[email protected]>

* fix kustomize version v5.0.3 in tests

Signed-off-by: Alin Spinu <[email protected]>

* minor changes to manifest apply method in pipeline deployment script

Signed-off-by: Alin Spinu <[email protected]>

* fix

Signed-off-by: Alin Spinu <[email protected]>

* fix kustomize release

Signed-off-by: Alin Spinu <[email protected]>

* fix archive

Signed-off-by: Alin Spinu <[email protected]>

* fix bin

Signed-off-by: Alin Spinu <[email protected]>

* replace patchStrategicMerge refs in test manifests

Signed-off-by: Alin Spinu <[email protected]>

* replace kustomize version with 5.2.1

Signed-off-by: Alin Spinu <[email protected]>

* replace all kustomize versions with 5.2.1

Signed-off-by: Alin Spinu <[email protected]>

---------

Signed-off-by: Alin Spinu <[email protected]>

…ification eval pipeline

PiperOrigin-RevId: 621897220

PiperOrigin-RevId: 621998414

…ubeflow#10575)

Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.6.1 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](follow-redirects/follow-redirects@v1.6.1...v1.15.6)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…ver/visualization (kubeflow#10658)

Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.0.1 to 10.3.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](python-pillow/Pillow@10.0.1...10.3.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…esolve_upload_location from function_based

PiperOrigin-RevId: 622081254

…w#10639)

Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](expressjs/express@4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Chen Sun <[email protected]>

… `chat` variants of `bison@001` with the `preview.llm.rlhf_pipeline`

PiperOrigin-RevId: 622229648

…/server (kubeflow#10574)

Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.5.10 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](follow-redirects/follow-redirects@v1.5.10...v1.15.6)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…low#10659)

these samples currently only work on the Google Cloud distribution
because of hardcoded secret name that only pre-exists there.
1 extract the hardcoded secret name to a const to make it a little
easier to change
2 add a note about it.

Signed-off-by: Greg Sheremeta <[email protected]>

* remove deprecated ibm components

Signed-off-by: tomcli <[email protected]>

* update linkage to the ibm components

Signed-off-by: tomcli <[email protected]>

---------

Signed-off-by: tomcli <[email protected]>