Skip to content

Commit

Permalink
Add notes for dev_mode and refresh params
Browse files Browse the repository at this point in the history
  • Loading branch information
burnash committed Jun 12, 2024
1 parent 87f3f4d commit b4214f1
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions docs/website/docs/general-usage/incremental-loading.md
Original file line number Diff line number Diff line change
Expand Up @@ -982,11 +982,13 @@ def search_tweets(twitter_bearer_token=dlt.secrets.value, search_terms=None, sta

If you see that the incremental loading is not working as expected and the incremental values are not modified between pipeline runs, check the following:

1. Make sure the destination, pipeline name and dataset name are the same between pipeline runs.
1. Make sure the `destination`, `pipeline_name` and `dataset_name` are the same between pipeline runs.

2. Check the logs for `Bind incremental on <resource_name> ...` message. This message indicates that the incremental value was bound to the resource and shows the state of the incremental value.
2. Check if `dev_mode` is `False` in the pipeline configuration. Check if `refresh` for associated sources and resources is not enabled.

3. After the pipeline run, check the state of the pipeline. You can do this by running the following command:
3. Check the logs for `Bind incremental on <resource_name> ...` message. This message indicates that the incremental value was bound to the resource and shows the state of the incremental value.

4. After the pipeline run, check the state of the pipeline. You can do this by running the following command:

```sh
dlt pipeline -v <pipeline_name> info
Expand Down

0 comments on commit b4214f1

Please sign in to comment.