-
Notifications
You must be signed in to change notification settings - Fork 175
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
4 changed files
with
36 additions
and
20 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,21 +1,27 @@ | ||
# Data Sources | ||
|
||
Use [Data Sources](https://cloud.griptape.ai/data-sources) to connect and ingest your own data for use with your AI code. | ||
Use [Data Sources](https://cloud.griptape.ai/data-sources) to connect and ingest your own data for use with your AI applications via [Knowledge Bases](../knowledge-bases/index.md). | ||
|
||
## Create a Data Source | ||
|
||
You can [Create a Data Source](https://cloud.griptape.ai/data-sources/create) by specifying the required configuration for your chosen data source. | ||
You can [Create a Data Source](https://cloud.griptape.ai/data-sources/create) by specifying the required configuration for your chosen Data Source. | ||
|
||
If you do not see a data source coniguration you'd wish to use, you can submit a request via Discord or `[email protected]`. | ||
If you do not see a data source configuration you'd wish to use, you can submit a request via [Discord](https://discord.gg/gnWRz88eym) or `[email protected]`. | ||
|
||
## Refresh a Data Source | ||
|
||
By default your Data Source will not refresh automatically. You can enable automatic refresh and specify a CRON expression when creating a Data Source. | ||
### Automatic Refresh | ||
|
||
For example, if you wish your Data Source to refresh every day at midnight you can use the following expression: `0 0 * * *`. | ||
By default your Data Source will not refresh automatically. You can enable automatic refresh and specify a [CRON expression](https://crontab.guru/) when creating a Data Source. For example, if you wish your Data Source to refresh every day at midnight you can use the following expression: `0 0 * * *`. | ||
|
||
If you wish to manually refresh a data source you can do so either via the `Refresh` button on the UI or by API using the `Data Source ID` on the `Config` tab. You will need a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys) to make API calls. | ||
### Manual Refresh | ||
|
||
If you wish to manually refresh a data source you can do so either via the `Refresh` button on the UI or by API using the `Data Source ID` on the `Config` tab and a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys). | ||
|
||
The following shell commands will create a new data refresh job. You will need to specify your API key and data source id. | ||
|
||
```shell | ||
curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{}' https://cloud.griptape.ai/api/data-connectors/${data_source_id}/data-jobs | ||
export GT_CLOUD_API_KEY=<your API key here> | ||
export DATA_SOURCE_ID=<your data source id here> | ||
curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{}' https://cloud.griptape.ai/api/data-connectors/${DATA_SOURCE_ID}/data-jobs | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters