Skip to content

Commit

Permalink
Updated as per comments
Browse files Browse the repository at this point in the history
  • Loading branch information
dat-a-man committed May 24, 2024
1 parent f85d0d5 commit afe18bb
Showing 1 changed file with 7 additions and 6 deletions.
13 changes: 7 additions & 6 deletions docs/website/docs/dlt-ecosystem/destinations/filesystem.md
Original file line number Diff line number Diff line change
Expand Up @@ -359,6 +359,12 @@ Please note:

The filesystem destination configuration supports advanced layout customization and the inclusion of additional placeholders. This can be done through `config.toml` or programmatically when initializing via a factory method.

To set using environment variables:

```sh
export DESTINATION__FILESYSTEM__KWARGS = '{"auto_mkdir": true/false}'
```

:::tip
For handling deeply nested layouts, consider enabling automatic directory creation for the local filesystem destination. This can be done by setting `kwargs = '{"auto_mkdir": true}'` to facilitate the creation of directories automatically.
:::
Expand All @@ -371,15 +377,10 @@ To configure the layout and placeholders using `config.toml`, use the following
layout = "{table_name}/{test_placeholder}/{YYYY}-{MM}-{DD}/{ddd}/{mm}/{load_id}.{file_id}.{ext}"
extra_placeholders = { "test_placeholder" = "test_value" }
current_datetime="2024-04-14T00:00:00"
# for deeply nested layouts
# for automatic directory creation in the local filesystem
kwargs = '{"auto_mkdir": true}'
```

To set using environment variables:

```sh
export DESTINATION__FILESYSTEM__KWARGS = '{"auto_mkdir": true/false}'
```

:::note
Ensure that the placeholder names match the intended usage. For example, `{test_placeholer}` should be corrected to `{test_placeholder}` for consistency.
Expand Down

0 comments on commit afe18bb

Please sign in to comment.