Dagster #210

amotl · 2024-12-21T23:46:49Z

amotl
Dec 21, 2024
Maintainer

Data engineering doesn't need to be a drag.

Ship data pipelines quickly and confidently with the modern data orchestrator built for data engineers building data platforms.

Dagster is a cloud-native data pipeline orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability.
It is designed for developing and maintaining data assets, such as tables, data sets, machine learning models, and reports.
With Dagster, you declare—as Python functions—the data assets that you want to build. Dagster then helps you run your functions at the right time and keep your assets up-to-date.