-
Notifications
You must be signed in to change notification settings - Fork 1
Add support for minio copy workflow though API #141
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
| volumes: | ||
| - name: workflow-data-ingress | ||
| persistentVolumeClaim: | ||
| claimName: workflow-data-ingress |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Make this parameters rather than a pre-set name
| workflow_data_pvc = PersistentVolumeClaim( | ||
| "workflow-data-pvc", | ||
| metadata=ObjectMetaArgs( | ||
| name="workflow-data-ingress", | ||
| namespace=argo_workflows_ns.metadata.name, | ||
| ), | ||
| spec=PersistentVolumeClaimSpecArgs( | ||
| access_modes=["ReadWriteMany"], | ||
| storage_class_name="fridge", | ||
| resources=VolumeResourceRequirementsArgs(requests={"storage": "2Gi"}), | ||
| ), | ||
| ) | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think we want to be doing this here. This should be interfacing with the PVC defined in #140
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should generalise the template and avoid creating PVCs as part of this PR - see comments
Adds an API endpoint of
/object/move/$FILEwhich triggers aminio-copyworkflow specifying the ingress bucket and file to be copied.Copies the data to a PVC which is mounted into the workflow pod.
Authentication with minio is currently handled by the existing
argo-artifacts-miniosecret that exists in the pulumi (currently minio admin).Test workflow result: