Restore volumes failed - message: Secret is not getting created #3670

VolkerKozlowski · 2021-04-08T13:26:41Z

VolkerKozlowski
Apr 8, 2021

Hi all!

I am facing an issue with restore of persistent volumes since using Velero 1.5.3. With Velero 1.4.x there where no issues with the scenario described below. I guess there where some changes :-)

Any help on this would be highly appreciated.

Environment

Velero 1.5.4
Kubernetes 1.18.8

Issue

Restore of volumes failed with following message:

Errors:
  Velero:     <none>
  Cluster:    <none>
  Namespaces:
    media-namespace-1:  error preparing pods/media-namespace-1/medialibrary-7c68d9c6-m7vq9: rpc error: code = Unknown desc = Secret is not getting created

Not sure if that is the reason to not restore PV data correctly. But this is the only error message I found at all.

What did I do?

created a namespace with one pod and 3 pv attached to it (pod included annotation to backup volumes).
created a backup from only this namespace
restored from this backup into a new namespace.

Observations

Backup completed without any issues
Application has been restored fine but without persistent volume
Restic had not been triggered to restore volumes
There where no podvolumerestore instances created
Pod does not contain initializer pod (restic-restore-helper)

Backup

I took a backup of one namespace only with following command

 /velero backup create media-namespace-20210407-140800 --include-namespaces=media-namespace --storage-location internal

The backup completed without any errors

/velero backup describe media-namespace-20210407-140800  --details --insecure-skip-tls-verify
Name:         media-namespace-20210407-140800
Namespace:    mcs-backup
Labels:       velero.io/storage-location=internal
Annotations:  velero.io/source-cluster-k8s-gitversion=v1.18.8
              velero.io/source-cluster-k8s-major-version=1
              velero.io/source-cluster-k8s-minor-version=18

Phase:  Completed

Errors:    0
Warnings:  0

Namespaces:
  Included:  media-namespace
  Excluded:  <none>

Resources:
  Included:        *
  Excluded:        <none>
  Cluster-scoped:  auto

Label selector:  <none>

Storage Location:  internal

Velero-Native Snapshot PVs:  auto

TTL:  720h0m0s

Hooks:  <none>

Backup Format Version:  1.1.0

Started:    2021-04-08 12:08:16 +0000 UTC
Completed:  2021-04-08 12:08:50 +0000 UTC

Expiration:  2021-05-08 12:08:16 +0000 UTC

Total items to be backed up:  33
Items backed up:              33

Resource List:
  apps/v1/Deployment:
    - media-namespace/medialibrary
  apps/v1/ReplicaSet:
    - media-namespace/medialibrary-7c68d9c6
  v1/Event:
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673d91d4a38884c
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673d91d9c982854
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673d92196c4ee7c
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673d921b0e19aa8
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673d921ba710bf8
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673ddc6ca1ed5c7
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673ddc709d2371e
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673ddc7285a312a
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673ddc732e2c68b
    - media-namespace/medialibrary-7c68d9c6-m7vq9.1673ddc76a1ea171
    - media-namespace/medialibrary-7c68d9c6.1673d91d4662aff4
    - media-namespace/medialibrary.1673d91cc9b4da54
    - media-namespace/pvc-1.1673d91ccee600d4
    - media-namespace/pvc-1.1673d91cdc23cb28
    - media-namespace/pvc-1.1673d91d0a51879c
    - media-namespace/pvc-2.1673d91cd1e3b330
    - media-namespace/pvc-2.1673d91cdc232204
    - media-namespace/pvc-2.1673d91cfe443da0
    - media-namespace/pvc-3.1673d91cd568f894
    - media-namespace/pvc-3.1673d91cdc23cb28
    - media-namespace/pvc-3.1673d91cf3c910a8
  v1/Namespace:
    - media-namespace
  v1/PersistentVolume:
    - pvc-70d31102-3ff9-4cbd-9953-e037f3efcc12
    - pvc-8321dd3a-b68e-47c1-a047-c25c33943829
    - pvc-ac6687c8-1c2a-48d9-94a3-0d16623f392b
  v1/PersistentVolumeClaim:
    - media-namespace/pvc-1
    - media-namespace/pvc-2
    - media-namespace/pvc-3
  v1/Pod:
    - media-namespace/medialibrary-7c68d9c6-m7vq9
  v1/Secret:
    - media-namespace/default-token-m6nl9
  v1/ServiceAccount:
    - media-namespace/default

Velero-Native Snapshots: <none included>

Restic Backups:
  Completed:
    media-namespace/medialibrary-7c68d9c6-m7vq9: volume-1, volume-2, volume-3

Restore

Restore from previously created backup:

/velero restore create --from-backup media-namespace-20210407-140800 --namespace-mappings=media-namespace:media-namespace-1

 /velero restore get
NAME                                             BACKUP                            STATUS            STARTED                         COMPLETED                       ERRORS   WARNINGS   CREATED                         SELECTOR
media-namespace-20210407-140800-20210408120948   media-namespace-20210407-140800   PartiallyFailed   2021-04-08 12:09:48 +0000 UTC   2021-04-08 12:09:57 +0000 UTC   1        0          2021-04-08 12:09:48 +0000 UTC   <none>

Details of Restore

/velero restore describe media-namespace-20210407-140800-20210408120948 --insecure-skip-tls-verify
Name:         media-namespace-20210407-140800-20210408120948
Namespace:    mcs-backup
Labels:       <none>
Annotations:  <none>

Phase:  PartiallyFailed (run 'velero restore logs media-namespace-20210407-140800-20210408120948' for more information)

Started:    2021-04-08 12:09:48 +0000 UTC
Completed:  2021-04-08 12:09:57 +0000 UTC

Errors:
  Velero:     <none>
  Cluster:    <none>
  Namespaces:
    media-namespace-1:  error preparing pods/media-namespace-1/medialibrary-7c68d9c6-m7vq9: rpc error: code = Unknown desc = Secret is not getting created

Backup:  media-namespace-20210407-140800

Namespaces:
  Included:  all namespaces found in the backup
  Excluded:  <none>

Resources:
  Included:        *
  Excluded:        nodes, events, events.events.k8s.io, backups.velero.io, restores.velero.io, resticrepositories.velero.io
  Cluster-scoped:  auto

Namespace mappings:  media-namespace=media-namespace-1

Label selector:  <none>

Restore PVs:  auto

Log from Restore

/velero restore create --from-backup media-namespace-20210407-140800 --namespace-mappings=media-namespace:media-namespace-1


time="2021-04-08T12:09:48Z" level=debug msg="Running processQueueItem" controller=restore key=mcs-backup/media-namespace-20210407-140800-20210408120948 logSource="pkg/controller/restore_controller.go:183"
time="2021-04-08T12:09:48Z" level=debug msg="Getting Restore" controller=restore key=mcs-backup/media-namespace-20210407-140800-20210408120948 logSource="pkg/controller/restore_controller.go:191"
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" controller=restore kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/aws
time="2021-04-08T12:09:48Z" level=debug msg="creating new restartable plugin process" command=/plugins/velero-plugin-for-aws controller=restore kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:120" name=velero.io/aws
time="2021-04-08T12:09:48Z" level=debug msg="starting plugin" args="[/plugins/velero-plugin-for-aws --log-level debug]" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws
time="2021-04-08T12:09:48Z" level=debug msg="plugin started" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws pid=215
time="2021-04-08T12:09:48Z" level=debug msg="waiting for RPC address" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws
time="2021-04-08T12:09:48Z" level=debug msg="Setting log level to DEBUG" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/framework/server.go:178" pluginName=velero-plugin-for-aws
time="2021-04-08T12:09:48Z" level=debug msg="plugin address" address=/tmp/plugin526767546 cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" network=unix pluginName=velero-plugin-for-aws
time="2021-04-08T12:09:48Z" level=debug msg="using plugin" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" version=2
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/add-pv-from-pvc restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="creating new restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:120" name=velero.io/add-pv-from-pvc restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="starting plugin" args="[/velero run-plugins --log-level debug]" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="plugin started" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/velero pid=224 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="waiting for RPC address" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="Setting log level to DEBUG" cmd=/velero logSource="pkg/plugin/framework/server.go:199" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="plugin address" address=/tmp/plugin316305521 cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" network=unix pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="using plugin" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948 version=2
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/add-pvc-from-pod restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/add-pvc-from-pod restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/change-pvc-node-selector restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/change-pvc-node-selector restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/change-storage-class restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/change-storage-class restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/cluster-role-bindings restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/cluster-role-bindings restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/crd-preserve-fields restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/crd-preserve-fields restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/init-restore-hook restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/init-restore-hook restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/job restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/job restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/pod restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/pod restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/restic restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/restic restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/role-bindings restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/role-bindings restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/service restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/service restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/service-account restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=velero.io/service-account restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/01-common-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="creating new restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:120" name=openshift.io/01-common-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="starting plugin" args="[/plugins/velero-plugins --log-level debug]" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="plugin started" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugins pid=232 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="waiting for RPC address" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="using plugin" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948 version=2
time="2021-04-08T12:09:48Z" level=debug msg="plugin address" address=/tmp/plugin004486932 cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" network=unix pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/02-serviceaccount-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/02-serviceaccount-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/03-pv-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/03-pv-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/04-imagestreamtag-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/04-imagestreamtag-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/04-pvc-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/04-pvc-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/05-route-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/05-route-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/06-build-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/06-build-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/07-pod-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/07-pod-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/08-deploymentconfig-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/08-deploymentconfig-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/09-replicationcontroller-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/09-replicationcontroller-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/10-job-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/10-job-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/11-daemonset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/11-daemonset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/12-replicaset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/12-replicaset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/13-deployment-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/13-deployment-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/14-statefulset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/14-statefulset-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/15-service-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/15-service-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/16-cronjob-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/16-cronjob-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/17-buildconfig-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/17-buildconfig-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/18-secret-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/18-secret-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/19-is-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/19-is-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/20-SCC-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/20-SCC-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/21-role-bindings-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/21-role-bindings-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/22-cluster-role-bindings-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/22-cluster-role-bindings-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=openshift.io/23-imagetag-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:48Z" level=debug msg="found preexisting restartable plugin process" command=/plugins/velero-plugins kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:116" name=openshift.io/23-imagetag-restore-plugin restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:49Z" level=debug msg="Copied Backup to file" backup=media-namespace-20210407-140800 bytes=11370 fileName=/tmp/media-namespace-20210407-140800374759452 logSource="pkg/controller/restore_controller.go:566" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:49Z" level=debug msg="Checking if object exists" bucket=vkozlows-local-backup-internal cmd=/plugins/velero-plugin-for-aws controller=restore key=backups/media-namespace-20210407-140800/media-namespace-20210407-140800-volumesnapshots.json.gz logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-aws/velero-plugin-for-aws/object_store.go:306" pluginName=velero-plugin-for-aws
time="2021-04-08T12:09:49Z" level=debug msg="Object exists" bucket=vkozlows-local-backup-internal cmd=/plugins/velero-plugin-for-aws controller=restore key=backups/media-namespace-20210407-140800/media-namespace-20210407-140800-volumesnapshots.json.gz logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-aws/velero-plugin-for-aws/object_store.go:328" pluginName=velero-plugin-for-aws
time="2021-04-08T12:09:49Z" level=info msg="starting restore" logSource="pkg/controller/restore_controller.go:467" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:49Z" level=info msg="Starting restore of backup mcs-backup/media-namespace-20210407-140800" logSource="pkg/restore/restore.go:363" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="Skipping restore of resource because it's not present in the backup tarball" logSource="pkg/restore/restore.go:429" resource=customresourcedefinitions.apiextensions.k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="Skipping restore of resource because it's not present in the backup tarball" logSource="pkg/restore/restore.go:429" resource=storageclasses.storage.k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping restore of resource because it cannot be resolved via discovery" logSource="pkg/restore/restore.go:401" resource=volumesnapshotclass.snapshot.storage.k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping restore of resource because it cannot be resolved via discovery" logSource="pkg/restore/restore.go:401" resource=volumesnapshotcontents.snapshot.storage.k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping restore of resource because it cannot be resolved via discovery" logSource="pkg/restore/restore.go:401" resource=volumesnapshots.snapshot.storage.k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Restoring cluster level resource 'persistentvolumes'" logSource="pkg/restore/restore.go:726" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Getting client for /v1, Kind=PersistentVolume" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Dynamically re-provisioning persistent volume because it has a restic backup to be restored." logSource="pkg/restore/restore.go:963" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Dynamically re-provisioning persistent volume because it has a restic backup to be restored." logSource="pkg/restore/restore.go:963" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Dynamically re-provisioning persistent volume because it has a restic backup to be restored." logSource="pkg/restore/restore.go:963" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Restoring resource 'persistentvolumeclaims' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Getting client for /v1, Kind=PersistentVolumeClaim" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing AddPVFromPVCAction" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:44" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Adding PV pvc-70d31102-3ff9-4cbd-9953-e037f3efcc12 as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:66" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping persistentvolumes/pvc-70d31102-3ff9-4cbd-9953-e037f3efcc12 because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="PVC doesn't have node selector" cmd=/velero kind=PersistentVolumeClaim logSource="pkg/restore/change_pvc_node_selector.go:92" name=pvc-1 namespace=media-namespace pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:93" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="Getting plugin config" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:68" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="No storage class mappings found" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:75" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:76" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] common restore plugin for pvc-1" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[pvc-restore] Returning pvc object as is since this is not a migration activity" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/pvc/restore.go:28" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Resetting PersistentVolumeClaim media-namespace-1/pvc-1 for dynamic provisioning" logSource="pkg/restore/restore.go:1081" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Attempting to restore PersistentVolumeClaim: pvc-1" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing AddPVFromPVCAction" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:44" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Adding PV pvc-ac6687c8-1c2a-48d9-94a3-0d16623f392b as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:66" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping persistentvolumes/pvc-ac6687c8-1c2a-48d9-94a3-0d16623f392b because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="PVC doesn't have node selector" cmd=/velero kind=PersistentVolumeClaim logSource="pkg/restore/change_pvc_node_selector.go:92" name=pvc-2 namespace=media-namespace pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:93" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="Getting plugin config" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:68" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="No storage class mappings found" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:75" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:76" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] common restore plugin for pvc-2" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[pvc-restore] Returning pvc object as is since this is not a migration activity" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/pvc/restore.go:28" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Resetting PersistentVolumeClaim media-namespace-1/pvc-2 for dynamic provisioning" logSource="pkg/restore/restore.go:1081" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Attempting to restore PersistentVolumeClaim: pvc-2" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing AddPVFromPVCAction" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:44" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Adding PV pvc-8321dd3a-b68e-47c1-a047-c25c33943829 as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pv_from_pvc_action.go:66" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Skipping persistentvolumes/pvc-8321dd3a-b68e-47c1-a047-c25c33943829 because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="PVC doesn't have node selector" cmd=/velero kind=PersistentVolumeClaim logSource="pkg/restore/change_pvc_node_selector.go:92" name=pvc-3 namespace=media-namespace pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangePVCNodeSelectorAction" cmd=/velero logSource="pkg/restore/change_pvc_node_selector.go:93" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="Getting plugin config" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:68" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=debug msg="No storage class mappings found" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:75" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Done executing ChangeStorageClassAction" cmd=/velero logSource="pkg/restore/change_storageclass_action.go:76" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] common restore plugin for pvc-3" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for persistentvolumeclaims" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[pvc-restore] Returning pvc object as is since this is not a migration activity" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/pvc/restore.go:28" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Resetting PersistentVolumeClaim media-namespace-1/pvc-3 for dynamic provisioning" logSource="pkg/restore/restore.go:1081" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Attempting to restore PersistentVolumeClaim: pvc-3" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Restoring resource 'secrets' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Getting client for /v1, Kind=Secret" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="Executing item action for secrets" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:55Z" level=info msg="[common-restore] common restore plugin for default-token-m6nl9" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for secrets" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[secret-restore] Entering Secret restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/secret/restore.go:29" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[secret-restore] Secret: default-token-m6nl9" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/secret/restore.go:34" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Attempting to restore Secret: default-token-m6nl9" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's not present in the backup tarball" logSource="pkg/restore/restore.go:429" resource=configmaps restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Restoring resource 'serviceaccounts' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Getting client for /v1, Kind=ServiceAccount" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for serviceaccounts" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing ServiceAccountAction" cmd=/velero logSource="pkg/restore/service_account_action.go:47" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Checking secrets" cmd=/velero logSource="pkg/restore/service_account_action.go:57" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948 serviceaccount=media-namespace/default
time="2021-04-08T12:09:56Z" level=debug msg="Checking if secret default-token-m6nl9 matches default-token-" cmd=/velero logSource="pkg/restore/service_account_action.go:61" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948 serviceaccount=media-namespace/default
time="2021-04-08T12:09:56Z" level=debug msg="Match found - excluding this secret" cmd=/velero logSource="pkg/restore/service_account_action.go:65" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948 serviceaccount=media-namespace/default
time="2021-04-08T12:09:56Z" level=info msg="Done executing ServiceAccountAction" cmd=/velero logSource="pkg/restore/service_account_action.go:78" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for serviceaccounts" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] common restore plugin for default" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for serviceaccounts" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[serviceaccount-restore] Entering ServiceAccount restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/serviceaccount/restore.go:27" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[serviceaccount-restore] Checking for pull secrets to remove" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/serviceaccount/restore.go:33" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Attempting to restore ServiceAccount: default" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="ServiceAccount media-namespace-1/default successfully updated" logSource="pkg/restore/restore.go:1155" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's not present in the backup tarball" logSource="pkg/restore/restore.go:429" resource=limitranges restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Restoring resource 'pods' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Getting client for /v1, Kind=Pod" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing AddPVCFromPodAction" cmd=/velero logSource="pkg/restore/add_pvc_from_pod_action.go:44" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Adding PVC media-namespace/pvc-1 as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pvc_from_pod_action.go:58" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Adding PVC media-namespace/pvc-2 as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pvc_from_pod_action.go:58" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Adding PVC media-namespace/pvc-3 as an additional item to restore" cmd=/velero logSource="pkg/restore/add_pvc_from_pod_action.go:58" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping persistentvolumeclaims/media-namespace-1/pvc-1 because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping persistentvolumeclaims/media-namespace-1/pvc-2 because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping persistentvolumeclaims/media-namespace-1/pvc-3 because it's already been restored." logSource="pkg/restore/restore.go:866" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing InitRestoreHookPodAction" cmd=/velero logSource="pkg/restore/init_restorehook_pod_action.go:49" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Pod media-namespace/medialibrary-7c68d9c6-m7vq9 has no init.hook.restore.velero.io/container-image annotation, no initRestoreHook in annotation" cmd=/velero logSource="internal/hook/item_hook_handler.go:350" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Handling InitRestoreHooks from RestoreSpec" cmd=/velero logSource="internal/hook/item_hook_handler.go:138" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Returning pod media-namespace/medialibrary-7c68d9c6-m7vq9 with 0 init container(s)" cmd=/velero logSource="internal/hook/item_hook_handler.go:157" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Returning from InitRestoreHookPodAction" cmd=/velero logSource="pkg/restore/init_restorehook_pod_action.go:57" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing ResticRestoreAction" cmd=/velero logSource="pkg/restore/restic_restore_action.go:71" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Restic backups for pod found" cmd=/velero logSource="pkg/restore/restic_restore_action.go:106" pluginName=velero pod=media-namespace/medialibrary-7c68d9c6-m7vq9 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Getting plugin config" cmd=/velero logSource="pkg/restore/restic_restore_action.go:110" pluginName=velero pod=media-namespace/medialibrary-7c68d9c6-m7vq9 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Plugin config contains image name with tag" cmd=/velero image="mtr.external.otc.telekomcloud.com/paas/mcs-velero-restore-helper:v1.2.0" logSource="pkg/restore/restic_restore_action.go:221" pluginName=velero pod=media-namespace/medialibrary-7c68d9c6-m7vq9 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Using image \"mtr.external.otc.telekomcloud.com/paas/mcs-velero-restore-helper:v1.2.0\"" cmd=/velero logSource="pkg/restore/restic_restore_action.go:117" pluginName=velero pod=media-namespace/medialibrary-7c68d9c6-m7vq9 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="No custom command configured" cmd=/velero logSource="pkg/restore/restic_restore_action.go:185" pluginName=velero pod=media-namespace/medialibrary-7c68d9c6-m7vq9 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Done executing ResticRestoreAction" cmd=/velero logSource="pkg/restore/restic_restore_action.go:175" pluginName=velero restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] common restore plugin for medialibrary-7c68d9c6-m7vq9" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for pods" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[pod-restore] Entering Pod restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/pod/restore.go:33" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[pod-restore] pod: medialibrary-7c68d9c6-m7vq9" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/pod/restore.go:38" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[util] container image ref mtr.external.otc.telekomcloud.com/demo/e2etest-app:dev" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/util.go:96" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[util] container image ref mtr.external.otc.telekomcloud.com/paas/mcs-velero-restore-helper:v1.2.0" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/util.go:96" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Restoring resource 'replicasets.apps' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Getting client for apps/v1, Kind=ReplicaSet" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for replicasets.apps" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] common restore plugin for medialibrary-7c68d9c6" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for replicasets.apps" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[replicaset-restore] Entering ReplicaSet restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/replicaset/restore.go:27" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[replicaset-restore] replicaset: medialibrary-7c68d9c6" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/replicaset/restore.go:32" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[util] container image ref mtr.external.otc.telekomcloud.com/demo/e2etest-app:dev" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/util.go:96" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[replicaset-restore] skipping restore of ReplicaSet medialibrary-7c68d9c6, belongs to Deployment" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/replicaset/restore.go:49" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping restore of ReplicaSet: medialibrary-7c68d9c6 because a registered plugin discarded it" logSource="pkg/restore/restore.go:1015" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping restore of resource because it cannot be resolved via discovery" logSource="pkg/restore/restore.go:401" resource=clusters.cluster.x-k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping restore of resource because it cannot be resolved via discovery" logSource="pkg/restore/restore.go:401" resource=clusterresourcesets.addons.cluster.x-k8s.io restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Restoring resource 'deployments.apps' into namespace 'media-namespace-1'" logSource="pkg/restore/restore.go:724" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Getting client for apps/v1, Kind=Deployment" logSource="pkg/restore/restore.go:768" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for deployments.apps" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Entering common restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:23" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] common restore plugin for medialibrary" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:30" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[GetRegistryInfo] value from clusterIP" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/shared.go:74" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[common-restore] Error getting registry route, assuming this is outside of OADP context." cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/restore.go:52" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Executing item action for deployments.apps" logSource="pkg/restore/restore.go:1002" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[deployment-restore] Entering Deployment restore plugin" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/deployment/restore.go:27" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[deployment-restore] deployment: medialibrary" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/deployment/restore.go:32" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="[util] container image ref mtr.external.otc.telekomcloud.com/demo/e2etest-app:dev" cmd=/plugins/velero-plugins logSource="/go/src/github.com/fusor/openshift-velero-plugin/velero-plugins/common/util.go:96" pluginName=velero-plugins restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Attempting to restore Deployment: medialibrary" logSource="pkg/restore/restore.go:1107" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Skipping restore of resource because the restore spec excludes it" logSource="pkg/restore/restore.go:416" resource=events restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=persistentvolumeclaims restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=persistentvolumes restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=pods restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=replicasets.apps restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=secrets restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Skipping restore of resource because it's already been processed" logSource="pkg/restore/restore.go:410" resource=serviceaccounts restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Waiting for all restic restores to complete" logSource="pkg/restore/restore.go:488" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Done waiting for all restic restores to complete" logSource="pkg/restore/restore.go:504" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Waiting for all post-restore-exec hooks to complete" logSource="pkg/restore/restore.go:508" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="Done waiting for all post-restore exec hooks to complete" logSource="pkg/restore/restore.go:516" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=info msg="restore completed" logSource="pkg/controller/restore_controller.go:482" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="looking for plugin in registry" kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:105" name=velero.io/aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="creating new restartable plugin process" command=/plugins/velero-plugin-for-aws kind=ObjectStore logSource="pkg/plugin/clientmgmt/manager.go:120" name=velero.io/aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="starting plugin" args="[/plugins/velero-plugin-for-aws --log-level debug]" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="plugin started" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws pid=242 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="waiting for RPC address" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="Setting log level to DEBUG" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/framework/server.go:178" pluginName=velero-plugin-for-aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="plugin address" address=/tmp/plugin919871482 cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" network=unix pluginName=velero-plugin-for-aws restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:56Z" level=debug msg="using plugin" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948 version=2
time="2021-04-08T12:09:57Z" level=debug msg="plugin process exited" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugins pid=232 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="plugin exited" cmd=/plugins/velero-plugins logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="plugin process exited" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws pid=242 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="plugin exited" cmd=/plugins/velero-plugin-for-aws logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="plugin process exited" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/velero pid=224 restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="plugin exited" cmd=/velero logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" restore=mcs-backup/media-namespace-20210407-140800-20210408120948
time="2021-04-08T12:09:57Z" level=debug msg="Restore partially failed" controller=restore logSource="pkg/controller/restore_controller.go:266"
time="2021-04-08T12:09:57Z" level=debug msg="Updating restore's final status" controller=restore logSource="pkg/controller/restore_controller.go:276"
time="2021-04-08T12:09:57Z" level=debug msg="plugin process exited" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74" path=/plugins/velero-plugin-for-aws pid=215
time="2021-04-08T12:09:57Z" level=debug msg="plugin exited" cmd=/plugins/velero-plugin-for-aws controller=restore logSource="pkg/plugin/clientmgmt/logrus_adapter.go:74"
time="2021-04-08T12:09:58Z" level=debug msg="Checking for existing backup storage locations to sync into cluster" controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:124"
time="2021-04-08T12:09:58Z" level=debug msg="Checking if backups need to be synced at this time for this location" backupLocation=internal controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:157"

Answered by VolkerKozlowski

Apr 21, 2021

Created a new fork from scratch based on 1.6.0. Issue does not occur anymore :-) Actually don't know what caused the issue.

View full answer

VolkerKozlowski · 2021-04-08T14:06:01Z

VolkerKozlowski
Apr 8, 2021
Author

Additional information:
When excluding the pod from restore with /velero restore create --from-backup media-namespace-20210407-140800 --namespace-mappings=media-namespace:media-namespace-4 --exclude-resources pods the restore completes without any errors.

0 replies

VolkerKozlowski · 2021-04-09T15:09:06Z

VolkerKozlowski
Apr 9, 2021
Author

Additional information:
Instead of using our Velero 1.5.4 fork I used the upstream Velero 1.5.4: I am facing same issue :-(

0 replies

VolkerKozlowski · 2021-04-21T12:40:42Z

VolkerKozlowski
Apr 21, 2021
Author

Created a new fork from scratch based on 1.6.0. Issue does not occur anymore :-) Actually don't know what caused the issue.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Restore volumes failed - message: Secret is not getting created #3670

{{title}}

Replies: 3 comments

{{title}}

{{title}}

{{title}}

Select a reply

Restore volumes failed - message: Secret is not getting created #3670

VolkerKozlowski Apr 8, 2021

Environment

Issue

What did I do?

Observations

Backup

Restore

Replies: 3 comments

VolkerKozlowski Apr 8, 2021 Author

VolkerKozlowski Apr 9, 2021 Author

VolkerKozlowski Apr 21, 2021 Author

VolkerKozlowski
Apr 8, 2021

VolkerKozlowski
Apr 8, 2021
Author

VolkerKozlowski
Apr 9, 2021
Author

VolkerKozlowski
Apr 21, 2021
Author