From 2183055fcfa5f70dddc78cb7d5f33ba4ce0db3e6 Mon Sep 17 00:00:00 2001 From: Joe Reuter Date: Tue, 17 Oct 2023 18:27:21 +0200 Subject: [PATCH] Apify Dataset: Remove unnecessary breaking change and improve documentation (#31462) --- .../connectors/source-apify-dataset/metadata.yaml | 5 +---- docs/integrations/sources/apify-dataset-migrations.md | 10 +++++----- 2 files changed, 6 insertions(+), 9 deletions(-) diff --git a/airbyte-integrations/connectors/source-apify-dataset/metadata.yaml b/airbyte-integrations/connectors/source-apify-dataset/metadata.yaml index 70a8c083a8b7..6fc16080b973 100644 --- a/airbyte-integrations/connectors/source-apify-dataset/metadata.yaml +++ b/airbyte-integrations/connectors/source-apify-dataset/metadata.yaml @@ -25,10 +25,7 @@ data: message: "Update spec to use token and ingest all 3 streams correctly" 2.0.0: upgradeDeadline: 2023-09-18 - message: "Fix broken stream, manifest refactor" - 2.1.0: - upgradeDeadline: 2023-10-27 - message: "Rename dataset streams" + message: "This version introduces a new Item Collection (WCC) stream as a substitute of the now-removed Item Collection stream in order to retain data for Web-Content-Crawler datasets." supportLevel: community documentationUrl: https://docs.airbyte.com/integrations/sources/apify-dataset tags: diff --git a/docs/integrations/sources/apify-dataset-migrations.md b/docs/integrations/sources/apify-dataset-migrations.md index dbc7e63056d2..f4bb1ed7c329 100644 --- a/docs/integrations/sources/apify-dataset-migrations.md +++ b/docs/integrations/sources/apify-dataset-migrations.md @@ -1,12 +1,12 @@ # Apify Dataset Migration Guide -## Upgrading to 2.1.0 - -A minor update adding a new stream `item_collection` for general datasets. No actions are required regarding your current connector configuration setup. - ## Upgrading to 2.0.0 -Major update: The old broken Item Collection stream has been removed and replaced with a new Item Collection (WCC) stream specific for the datasets produced by [Website Content Crawler](https://apify.com/apify/website-content-crawler) Actor. Please update your connector configuration setup. Note: The schema of the Apify Dataset is at least Actor-specific, so we cannot have a general Stream with a static schema for getting data from a Dataset. +Major update: The old broken Item Collection stream has been removed and replaced with a new Item Collection (WCC) stream specific for the datasets produced by [Website Content Crawler](https://apify.com/apify/website-content-crawler) Actor. In a follow-up release 2.1.0, a generic item collection stream will be added to support all other datasets. + +After upgrading, users should: +- Reconfigure dataset id and API key +- Reset all streams ## Upgrading to 1.0.0