From 31caa0b0c9806f22d8ce5fc50919ba5d0466e1ca Mon Sep 17 00:00:00 2001 From: Emily Danielson Date: Thu, 12 Sep 2024 17:09:10 -0700 Subject: [PATCH 1/2] adding initial docs for structure as transform updating docs --- docs/griptape-cloud/data-sources/create-data-source.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/docs/griptape-cloud/data-sources/create-data-source.md b/docs/griptape-cloud/data-sources/create-data-source.md index aede0e9ee..eae83c513 100644 --- a/docs/griptape-cloud/data-sources/create-data-source.md +++ b/docs/griptape-cloud/data-sources/create-data-source.md @@ -22,6 +22,10 @@ You can connect to your personal or company Confluence by providing a URL, [Atla You can specify a [Structure](../structures/create-structure.md) to run as a Data Source as long as your Structure returns a [`TextArtifact` or `ListArtifact` from the Griptape Framework](../../griptape-framework/data/artifacts.md). You can use this as a way to build custom Data Sources. -## Other Data Source Types +### Other Data Source Types If you do not see a Data Source configuration you'd wish to use, you can submit a request via [Discord](https://discord.gg/gnWRz88eym) or `hello@griptape.ai`. + +## Adding Structure as Transform to Data Source (Experimental) + +When creating any Data Source, you can optionally specify a [Structure](../structures/create-structure.md) to run as a transform step of your data ingetstion before loading into the vector store. Ensure the Structure you select to run as a Transform is configured to take in a `ListArtifact` as its first positional argument and returns either a `TextArtifact` or `ListArtifact`. \ No newline at end of file From e88d6842df1ef7d0743aec95668649fa9741fbb2 Mon Sep 17 00:00:00 2001 From: Emily Danielson Date: Mon, 16 Sep 2024 12:37:25 -0700 Subject: [PATCH 2/2] adding sample transform link --- docs/griptape-cloud/data-sources/create-data-source.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/docs/griptape-cloud/data-sources/create-data-source.md b/docs/griptape-cloud/data-sources/create-data-source.md index eae83c513..347f52725 100644 --- a/docs/griptape-cloud/data-sources/create-data-source.md +++ b/docs/griptape-cloud/data-sources/create-data-source.md @@ -28,4 +28,6 @@ If you do not see a Data Source configuration you'd wish to use, you can submit ## Adding Structure as Transform to Data Source (Experimental) -When creating any Data Source, you can optionally specify a [Structure](../structures/create-structure.md) to run as a transform step of your data ingetstion before loading into the vector store. Ensure the Structure you select to run as a Transform is configured to take in a `ListArtifact` as its first positional argument and returns either a `TextArtifact` or `ListArtifact`. \ No newline at end of file +When creating any Data Source, you can optionally specify a [Structure](../structures/create-structure.md) to run as a transform step of your data ingetstion before loading into the vector store. Ensure the Structure you select to run as a transform is configured to take in a `ListArtifact` as its first positional argument and returns either a `TextArtifact` or `ListArtifact`. + +Take a look at the [Find and Replace Sample Structure](https://github.com/griptape-ai/griptape-sample-structures/tree/main/griptape-find-replace-transform) for more details on how to implement this for your own Structure. \ No newline at end of file