Skip to content

Commit

Permalink
Update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
ErickSeo committed Jan 16, 2025
1 parent f8bbb96 commit 39e3d02
Showing 1 changed file with 1 addition and 5 deletions.
6 changes: 1 addition & 5 deletions docs/features/datasets.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,8 @@
# Datasets

- [Datasets Outlets](#datasets-outlets)
- [Conditional Dataset Scheduling](#conditional-dataset-scheduling)
DAG Factory supports Airflow’s [Datasets](https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html).

## Datasets Outlets

DAG Factory supports Airflow’s [Datasets](https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html).

To leverage, you need to specify the `Dataset` in the `outlets` key in the configuration file. The `outlets` key is a list of strings that represent the dataset locations.
In the `schedule` key of the consumer dag, you can set the `Dataset` you would like to schedule against. The key is a list of strings that represent the dataset locations.
The consumer dag will run when all the datasets are available.
Expand Down

0 comments on commit 39e3d02

Please sign in to comment.