dagster

An orchestration platform for the development, production, and observation of data assets.

14.9k
Stars
+560
Gained
3.9%
Growth
Python
Language

💡 Why It Matters

Dagster addresses the complexities of data orchestration, enabling engineers to manage data pipelines efficiently. This open source tool for engineering teams is particularly beneficial for ML/AI teams, as it supports the development, production, and observation of data assets in a structured manner. With a steady growth of 560 stars over 96 days, Dagster demonstrates stable community interest and is considered a production-ready solution. However, it may not be the right choice for teams seeking a lightweight or simpler data management approach, as its capabilities can be overwhelming for smaller projects.

🎯 When to Use

Dagster is a strong choice for teams needing robust data orchestration and integration, especially in complex ML/AI workflows. Teams should consider alternatives if they require a more straightforward solution without the extensive features Dagster offers.

👥 Team Fit & Use Cases

This platform is ideal for data engineers, ML engineers, and data scientists who require a comprehensive orchestration tool. Dagster is commonly integrated into data pipelines, ETL processes, and analytics systems, making it a valuable addition to any data-centric product.

🎭 Best For

🏷️ Topics & Ecosystem

analytics dagster data-engineering data-integration data-orchestrator data-pipelines data-science etl metadata mlops orchestration python scheduler workflow workflow-automation

📊 Activity

Latest commit: 2026-02-13. Over the past 97 days, this repository gained 560 stars (+3.9% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.