Update to KF 1.6

fix dex configmap path (kubeflow#2179)

(cherry picked from commit 353254a)

Add kserve networkpolicy (kubeflow#2189)

* Create kserve

* Rename kserve to kserve.yaml

* Update kustomization.yaml

(cherry picked from commit 5e9fedb)

Sync kubeflow/pipelines manifests 1.8.2 (kubeflow#2223)

* Update kubeflow/pipelines manifests from 1.8.2

* update example, tests

(cherry picked from commit e794211)

Update kubeflow/kfp-tekton manifests from v1.2.1 (kubeflow#2222)

Signed-off-by: Yihong Wang <[email protected]>
(cherry picked from commit 5b1256f)

Update minio and metadata-envoy networkpolicy (kubeflow#2205)

* Update minio.yaml

* Add files via upload

* Update kustomization.yaml

(cherry picked from commit cbc18ec)

Test that each component can be applied in a K8s 1.22 cluster (kubeflow#2230)

* Add GH action for testing JWA manifests.

* Update permissions.

* Add GH actions for PodDefaults.

* Add GH actions for PodDefaults fix typo.

* Add GH actions for applying manifests in KinD for each component.

* Fix cert manager installation in all Actions.

* Address review comments for all GH actions.

(cherry picked from commit 76f3cf2)

common: Add Istio 1.14.1 manifests (kubeflow#2233)

* common: Add Istio 1.14.1 manifests

Signed-off-by: Dimitris Poulopoulos <[email protected]>

* testing: Update install Istio GH action script

Update GH actions to use Istio 1.14 for testing.

Signed-off-by: Dimitris Poulopoulos <[email protected]>
(cherry picked from commit 7a74ea2)

Sync kubeflow training operator manifests v1.5.0 rc.0 (kubeflow#2232)

* readme: Use new link for training-operator

Don't use the tf-operator but training-operator

Signed-off-by: Kimonas Sotirchos <[email protected]>

* hack: Update sync script for Training Operator

Signed-off-by: Kimonas Sotirchos <[email protected]>

* Update kubeflow/training-operator manifests from v1.5.0-rc.0

(cherry picked from commit 6fce75e)

Update kubeflow/katib manifests from v0.14.0-rc.0 (kubeflow#2234)

(cherry picked from commit dcbd493)

chore: Remove outdated Istio manifests (kubeflow#2163)

(cherry picked from commit bec0e26)

Update README with Istio 1.4.1 (kubeflow#2235)

Signed-off-by: Anna Jung (VMware) <[email protected]>
(cherry picked from commit f8318a8)

Remove istio 1.11 (kubeflow#2236)

Signed-off-by: Anna Jung (VMware) <[email protected]>
(cherry picked from commit 5c600ad)

Update Knative 1.4 (kubeflow#2231)

* knative: Update README for v1.4.0

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative: wget latest manifests

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative: Remove all comments

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative: Remove knative-ingress-gateway

Had to manually remove a `{}` object at the end, introduced by the yq
command.

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative: Update README for removing {}

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative: Set metadata.name in post-install-job

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative-eventing: Update with v1.4.0 manifests

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative-eventing: Remove comments

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative-eventing: Remove anchors

Signed-off-by: Kimonas Sotirchos <[email protected]>

* knative-eventing: Install only core

Signed-off-by: Kimonas Sotirchos <[email protected]>
(cherry picked from commit c602b5c)

Move all tests under tests dir (kubeflow#2237)

* tests: Move everything under tests

Signed-off-by: Kimonas Sotirchos <[email protected]>

* test: Move everything under test

Signed-off-by: Kimonas Sotirchos <[email protected]>
(cherry picked from commit 666bb8c)

remove kfserving component (kubeflow#2239)

(cherry picked from commit e05f2c6)

Change images of KinD configuration files to be compatible with v0.14.0 (kubeflow#2238)

* Change images of KinD configuration files to be compatible with v0.14.0

* Move everything under the tests folder.

* Update actions with the new name of the config file.

(cherry picked from commit 7221470)

Sync kserve manifests for v0.8.0 (kubeflow#2240)

* Update kserve manifests from v0.8.0

Update kserve/kserve manifests from 8079f375cbcedc4d45a1b4aade2e2308ea6f9ae8

Update kserve/models-web-app manifests from v0.8.0

* add auto script for kserve and kserve models webapp manifests

* update readme and kustomization

* add rretry in kserve install for webhook

* ignore error while installing

* move cmds to script to allow local testing and remove sleep

* move crd wait outside set +e

(cherry picked from commit c3db49b)

Update kubeflow/kubeflow manifests from v1.6.0-rc.0 (kubeflow#2242)

(cherry picked from commit 6b60781)

Update Dex for K8s 1.22 (kubeflow#2243)

* dex: Update for K8s 1.22

Needed to update the deprecated APIs from v1beta1 to v1 for:
* CRD for AuthCode
* ClusterRole
* ClusterRoleBinding

Signed-off-by: Kimonas Sotirchos <[email protected]>

* gh-actions: CI action for Dex

Create a GH Action that tests if:
1. Dex manifests can be applied in a KinD K8s 1.22 cluster
2. All pods can become ready

Signed-off-by: Kimonas Sotirchos <[email protected]>

* dex: Update image to 2.31.2

Signed-off-by: Kimonas Sotirchos <[email protected]>
(cherry picked from commit dca1071)

Update kubeflow/pipelines manifests from 2.0.0-alpha.3 (kubeflow#2250)

* Update kubeflow/pipelines manifests from 2.0.0-alpha.3

Signed-off-by: Anna Jung (VMware) <[email protected]>

* Move pipeline manifest test commands to a separate script

Signed-off-by: Anna Jung (VMware) <[email protected]>

* Change pipeline installation command back to apply crd only

Signed-off-by: Anna Jung (VMware) <[email protected]>
(cherry picked from commit d701e97)

istio: Remove Istio 1.14 overlays (kubeflow#2252)

Remove overlays in 'kubeflow-istio-resources' for version 1.14.

Signed-off-by: Dimitris Poulopoulos <[email protected]>
(cherry picked from commit 707f8f6)

knative: Updrade Knative to version 1.2 (kubeflow#2251)

* Update the README file
* Fetch the manifests for Knative serving 1.2.5
* Fetch the manifests for Knative eventing 1.2.4
* Remove comments, anchors and aliases

Signed-off-by: Dimitris Poulopoulos <[email protected]>
(cherry picked from commit 0660ee0)

readme: Update component versions (kubeflow#2253)

Signed-off-by: Kimonas Sotirchos <[email protected]>

Fix typo in the networkpolicies (kubeflow#2254)

Use KServe component in tests instead of KFServing (kubeflow#2164)

* Use KServe component in tests instead of KFServing as it is updated upstream https://github.com/kubeflow/pipelines/blob/master/samples/contrib/kubeflow-e2e-mnist/kubeflow-e2e-mnist.ipynb

* Add permalink

Extend Katib GH action to also create an experiment and assert it succeeds (kubeflow#2249)

* Extend Katib GH action to also create an experiment and assert it succeeds. (kubeflow#2248)

* Rearrange folders for KF objects in tests.

Sync kserve web app manifests v0.8.1 (kubeflow#2256)

* hack: Destinct sync script for the web app

Signed-off-by: Kimonas Sotirchos <[email protected]>

* Update kserve web app manifests from v0.8.1

* hack: Update the kserve sync script

Signed-off-by: Kimonas Sotirchos <[email protected]>

* e2e: Increase the timeout to 10mins

We've seen that quite frequently the test times out either because:
1. Pulling images can be slower depending on the connection
2. There might be some delays with the components to complete

We've noticed this for the Training Operator worker pod.

Signed-off-by: Kimonas Sotirchos <[email protected]>

* e2e: Change the cleanup script for kserve.io

The clean up script would previously try to delete kubeflow.org
inference services.

Signed-off-by: Kimonas Sotirchos <[email protected]>

Update kubeflow/kubeflow manifests from v1.6.0-rc.1 (kubeflow#2260)

.github/workflows/centraldb_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply CentralDashboard manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/centraldashboard/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/centraldashboard/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/kserve | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/dex_kind_test.yaml

@@ -0,0 +1,30 @@
+name: Build & Apply Dex manifests in KinD
+on:
+  pull_request:
+    paths:
+      - common/dex/base/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd common/dex
+        kustomize build overlays/istio | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/jwa_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply JWA manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/jupyter/jupyter-web-app/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/jupyter/jupyter-web-app/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/istio | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/katib_kind_test.yaml

@@ -0,0 +1,40 @@
+name: Build & Apply Katib manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/katib/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Install cert-manager
+      run: ./tests/gh-actions/install_cert_manager.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/katib/upstream
+        kubectl create ns kubeflow
+        kustomize build installs/katib-with-kubeflow | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s
+
+    - name: Create katib experiment
+      run: |
+        kubectl apply -f tests/gh-actions/katib_test.yaml
+        kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 300s
+        kubectl wait --for=condition=Succeeded experiments.kubeflow.org -n kubeflow-user --all --timeout 300s

.github/workflows/kserve_kind_test.yaml

@@ -0,0 +1,30 @@
+name: Build & Apply KServe manifests in KinD
+on:
+  pull_request:
+    paths:
+      - contrib/kserve/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Install cert-manager
+      run: ./tests/gh-actions/install_cert_manager.sh
+
+    - name: Build & Apply manifests
+      run: ./tests/gh-actions/install_kserve.sh

.github/workflows/nb_controller_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply Notebook Controller manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/jupyter/notebook-controller/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/jupyter/notebook-controller/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/kubeflow | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/pipeline_kind_test.yaml

@@ -0,0 +1,30 @@
+name: Build & Apply Kubeflow Pipelines manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/pipeline/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Install cert-manager
+      run: ./tests/gh-actions/install_cert_manager.sh
+
+    - name: Build & Apply manifests
+      run: ./tests/gh-actions/install_pipelines.sh

.github/workflows/poddefaults_kind_test.yaml

@@ -0,0 +1,34 @@
+name: Build & Apply PodDefaults manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/admission-webhook/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Install cert-manager
+      run: ./tests/gh-actions/install_cert_manager.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/admission-webhook/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/cert-manager | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/profiles_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply Profiles manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/profiles/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/profiles/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/kubeflow | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/tb_controller_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply Tensorboard Controller manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/tensorboard/tensorboard-controller/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/tensorboard/tensorboard-controller/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/kubeflow | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/train_operator_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply Training Operator manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/training-operator/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/training-operator/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/kubeflow | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s

.github/workflows/twa_kind_test.yaml

@@ -0,0 +1,31 @@
+name: Build & Apply TWA manifests in KinD
+on:
+  pull_request:
+    paths:
+      - apps/tensorboard/tensorboards-web-app/upstream/**
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v3
+
+    - name: Install KinD
+      run: ./tests/gh-actions/install_kind.sh
+
+    - name: Create KinD Cluster
+      run: kind create cluster --config tests/gh-actions/kind-cluster-1-22.yaml
+
+    - name: Install kustomize
+      run: ./tests/gh-actions/install_kustomize.sh
+
+    - name: Install Istio
+      run: ./tests/gh-actions/install_istio.sh
+
+    - name: Build & Apply manifests
+      run: |
+        cd apps/tensorboard/tensorboards-web-app/upstream
+        kubectl create ns kubeflow
+        kustomize build overlays/istio | kubectl apply -f -
+        kubectl wait --for=condition=Ready pods --all --all-namespaces --timeout 180s