From 1a01f33f1f1aa5a21a30b5ecf3919e5f11e460db Mon Sep 17 00:00:00 2001 From: nikki everett Date: Mon, 22 Jan 2024 11:23:15 -0600 Subject: [PATCH 1/2] remove broken link Signed-off-by: nikki everett --- docs/concepts/data_management.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/concepts/data_management.rst b/docs/concepts/data_management.rst index 33a7f499a1..bc138fdb84 100644 --- a/docs/concepts/data_management.rst +++ b/docs/concepts/data_management.rst @@ -168,7 +168,7 @@ Between Tasks Bringing in Your Own Datastores for Raw Data ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -Flytekit has a pluggable `data persistence layer `__. +Flytekit has a pluggable `data persistence layer. This is driven by PROTOCOL. For example, it is theoretically possible to use S3 ``s3://`` for metadata and GCS ``gcs://`` for raw data. It is also possible to create your own protocol ``my_fs://``, to change how data is stored and accessed. But for Metadata, the data should be accessible to Flyte control plane. From e854ed574451c5052916c6011aa353b4aa8aff8e Mon Sep 17 00:00:00 2001 From: nikki everett Date: Mon, 22 Jan 2024 13:36:46 -0600 Subject: [PATCH 2/2] fix formatting Signed-off-by: nikki everett --- docs/concepts/data_management.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/concepts/data_management.rst b/docs/concepts/data_management.rst index bc138fdb84..0d4edbd0a8 100644 --- a/docs/concepts/data_management.rst +++ b/docs/concepts/data_management.rst @@ -168,7 +168,7 @@ Between Tasks Bringing in Your Own Datastores for Raw Data ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -Flytekit has a pluggable `data persistence layer. +Flytekit has a pluggable data persistence layer. This is driven by PROTOCOL. For example, it is theoretically possible to use S3 ``s3://`` for metadata and GCS ``gcs://`` for raw data. It is also possible to create your own protocol ``my_fs://``, to change how data is stored and accessed. But for Metadata, the data should be accessible to Flyte control plane.