From 960a921980b7a09e5e922856de64ae91e77163b3 Mon Sep 17 00:00:00 2001 From: "George B. de Lima" <106821144+GeorgeLimaDev@users.noreply.github.com> Date: Thu, 17 Oct 2024 03:49:02 -0900 Subject: [PATCH 1/2] New translations extracting-data-from-master-data-with-search-and-scroll.md (English, United States) --- ...from-master-data-with-search-and-scroll.md | 30 +++++++++---------- 1 file changed, 15 insertions(+), 15 deletions(-) diff --git a/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md b/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md index bf74b27591..b2ed879f18 100644 --- a/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md +++ b/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md @@ -4,9 +4,9 @@ slug: "extracting-data-from-master-data-with-search-and-scroll" hidden: false createdAt: "2024-09-27T10:00:00.000Z" updatedAt: "2024-09-27T10:00:00.000Z" -excerpt: "Learn how to extract data from Master Data using the search and scroll endpoints, with best practices for optimizing queries and handling large datasets." +excerpt: "Learn how to extract data from Master Data using the search and scroll endpoints and best practices for optimizing queries and handling large datasets." seeAlso: - - "/docs/guides/pagination-in-the-master-data-api" +- "/docs/guides/pagination-in-the-master-data-api" --- In this guide, you will learn how to extract data from Master Data using the search and scroll endpoints, including when to use each route, how to optimize queries, and best practices. @@ -15,18 +15,18 @@ In this guide, you will learn how to extract data from Master Data using the sea ## Search -The search route is ideal when you need to find a specific set of documents within your store. It is particularly useful for paginated queries, where you want to retrieve up to 10000 documents in small chunks over multiple requests. Each page is limited to 100 documents. +The search route is ideal when you need to find a specific set of documents within your store. It is particularly useful for paginated queries, where you want to retrieve up to 10,000 documents in small chunks over multiple requests and each page is limited to 100 documents. ->ℹ When paginating, the `_sort` parameter is recommended. The API does not guarantee a specific order by default; therefore, omitting the `_sort` parameter may lead to duplicate documents or return unexpected pages. +>ℹ When paginating, the `_sort` parameter is recommended. The API does not guarantee a specific order by default. Therefore, omitting the `_sort` parameter may lead to duplicate documents or return unexpected pages. -See the Search endpoint reference depending on the Master Data version you are using: +Check the search endpoint reference for your Master Data version: -* [Master Data API v1 - Search](https://developers.vtex.com/docs/api-reference/masterdata-api#get-/api/dataentities/-acronym-/search) +* [Master Data API v1 - Search](https://developers.vtex.com/docs/api-reference/masterdata-api#get-/api/dataentities/-acronym-/search) * [Master Data API v2 - Search](https://developers.vtex.com/docs/api-reference/master-data-api-v2#get-/api/dataentities/-dataEntityName-/search) ### Best practices -When using the search endpoint, these best practices will help enhance your data retrieval process: +When using the search endpoint, these best practices will help optimize your data retrieval process: * **Apply filters to narrow your search**: Improve performance by reducing the number of documents returned. This speeds up the query and ensures that your requests are more efficient. * **Use exact values for queries instead of wildcards (`*`):** Heavy usage of wildcards may be subject to temporary blocks. @@ -36,14 +36,14 @@ When using the search endpoint, these best practices will help enhance your data ## Scroll -The scroll route is designed for extensive data retrieval, especially when integrating Master Data with external systems. It is the best choice if you need to query the entire database or when dealing with over 10000 documents. +The scroll route is designed for extensive data retrieval, especially when integrating Master Data with external systems. It is the best choice if you need to query the entire database or deal with over 10,000 documents. -See the Scroll endpoint reference depending on the Master Data version you are using: +Check the scroll endpoint reference for your Master Data version: -* [Master Data API v1 - Scroll](https://developers.vtex.com/docs/api-reference/masterdata-api#get-/api/dataentities/-acronym-/scroll) +* [Master Data API v1 - Scroll](https://developers.vtex.com/docs/api-reference/masterdata-api#get-/api/dataentities/-acronym-/scroll) * [Master Data API v2 - Scroll](https://developers.vtex.com/docs/api-reference/master-data-api-v2#get-/api/dataentities/-dataEntityName-/scroll) -Your first scroll request will return a token in the `X-VTEX-MD-TOKEN` response header. Inform this value in the `_token` query parameter for your next requests until you receive an empty list, indicating that all documents have been retrieved. +Your first scroll request will return a token in the `X-VTEX-MD-TOKEN` response header. Submit this value in the `_token` query parameter for your next requests until you receive an empty list, which indicates that all documents have been retrieved. >ℹ Learn more about [Scroll pagination in the Master Data API](https://developers.vtex.com/docs/guides/pagination-in-the-master-data-api#scroll-pagination). @@ -51,11 +51,11 @@ Your first scroll request will return a token in the `X-VTEX-MD-TOKEN` response To ensure efficient and reliable data retrieval, follow these strategies when using the scroll endpoint: -* **Implement filters to divide the request into smaller batches,** reducing the likelihood of timeouts. For example, you might filter by creation date and process data month by month. Smaller batches are also easier to reprocess if a timeout occurs, making your operation more resilient. -* **Run up to 10 scrolls simultaneously per account.** Limiting the number of parallel scrolls helps prevent errors and timeouts. By using filters to create smaller batches and parallelizing these batches in a controlled manner, you can speed up data retrieval while reducing the risk of overloading the account. +* **Implement filters to divide the request into smaller batches:** This reduces the likelihood of timeouts. For example, you might filter by created date and process data month by month. Smaller batches are also easier to reprocess if a timeout occurs, making your operation more resilient. +* **Run up to 10 scrolls simultaneously per account:** Limiting the number of parallel scrolls helps prevent errors and timeouts. By using filters to create smaller batches and parallelizing these batches in a controlled manner, you can speed up data retrieval while reducing the risk of overloading the account. >⚠️ **Scroll behavior and limitations** > -> * **Each scroll operation allows only one query for the duration of the token.** This means that you cannot change a scroll’s query by changing parameters after the first request: you can navigate pages of the original first request until the token expires, or initiate other scrolls (up to 10 simultaneously). +> * **Each scroll operation allows only one query for the duration of the token.** This means that you cannot change a scroll’s query by changing parameters after the first request. You can navigate pages of the original first request until the token expires, or initiate other scrolls (up to 10 simultaneously). > * If Master Data stops receiving requests with the scroll `X-VTEX-MD-TOKEN` token, it will expire in **20 minutes**. After that, you can make new scroll requests, limited to 10 simultaneous scrolls. -> * The maximum number of documents per scroll request is **1000**. +> * The maximum number of documents per scroll request is **1,000**. From 80a72efddefe7ddd2ce27015f00528c17ac24d76 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?J=C3=BAlia=20Rabello?= <77292838+julia-rabello@users.noreply.github.com> Date: Thu, 17 Oct 2024 10:38:48 -0300 Subject: [PATCH 2/2] add removed space --- .../extracting-data-from-master-data-with-search-and-scroll.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md b/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md index b2ed879f18..8210c40f0c 100644 --- a/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md +++ b/docs/localization/extracting-data-from-master-data-with-search-and-scroll.md @@ -6,7 +6,7 @@ createdAt: "2024-09-27T10:00:00.000Z" updatedAt: "2024-09-27T10:00:00.000Z" excerpt: "Learn how to extract data from Master Data using the search and scroll endpoints and best practices for optimizing queries and handling large datasets." seeAlso: -- "/docs/guides/pagination-in-the-master-data-api" + - "/docs/guides/pagination-in-the-master-data-api" --- In this guide, you will learn how to extract data from Master Data using the search and scroll endpoints, including when to use each route, how to optimize queries, and best practices.