Updated Filesystem Documentation: Handling Deeply Nested JSON #1385
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Add an example for post paginators * update the example cursor key * Update docs/website/docs/general-usage/http/rest-client.md Co-authored-by: VioletM <[email protected]> * Update docs/website/docs/general-usage/http/rest-client.md Co-authored-by: VioletM <[email protected]> * Update docs/website/docs/general-usage/http/rest-client.md * Add rest_api verified source documentation (#1308) * Add rest_api source docs * Expand rest_api documentation * Update snippets * Update string aliases * Link dlt source * Reordered code in the example and added a new section * Mention auto detection * Reorder the sentence about paginator types and instances * Elaborate on dependent resources; link the transformer docs * Link incremental loading * Update the example to use rest_api_resources * Rename github_config --------- Co-authored-by: Anton Burnashev <[email protected]> Co-authored-by: VioletM <[email protected]>
✅ Deploy Preview for dlt-hub-docs ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
* Added blogpost * Updated Anuun's comments. * Updated "docs/website/docs/dlt-ecosystem/verified-sources/rest_api.md" * updated docs/examples/custom_destination_bigquery/custom_destination_bigquery.py
VioletM
requested changes
May 24, 2024
| kwargs = '{"auto_mkdir": true}' | ||
| ``` | ||
|
|
||
| To set using environment variables: |
There was a problem hiding this comment.
Let's move this to the tip above (line 362)
| @@ -371,6 +371,14 @@ To configure the layout and placeholders using `config.toml`, use the following | |||
| layout = "{table_name}/{test_placeholder}/{YYYY}-{MM}-{DD}/{ddd}/{mm}/{load_id}.{file_id}.{ext}" | |||
| extra_placeholders = { "test_placeholder" = "test_value" } | |||
| current_datetime="2024-04-14T00:00:00" | |||
| # for deeply nested layouts | |||
There was a problem hiding this comment.
Suggested change
| # for deeply nested layouts | |
| # for automatic directory creation in the local filesystem |
dat-a-man
force-pushed
the
docs/update_filesystem_docs
branch
from
1762f09 to
9225803
Compare
|
@dat-a-man, you trying to merge changes from master to devel, you don;'t need to do that. Which branch did your branch originate from master or devel? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR updates the filesystem documentation to include instructions for handling deeply nested JSON files by enabling automatic directory creation.
Changes:
Documentation Update: