data-orchestration repositories
Trending repositories tagged data-orchestration, ranked by trending score. Updated daily.
-
1
kestra-io/kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
GitHub · Java · 30,310 stars · 3,547 forks · +19 stars in 24 hours · Trending score 2.79
-
2
cubefs/cubefs
cloud-native distributed storage
GitHub · Go · 5,700 stars · 721 forks · +6 stars in 24 hours · Trending score 1.60
-
3
goldener-data/goldener
Goldener - Make your data even more valuable - Open source data-centric orchestration for the full AI lifecycle
GitHub · Python · 18 stars · 29 forks · 0 stars in 24 hours · Trending score 0.88
-
4
flyingriverhorse/Kayra
Visual MLOps you host yourself: canvas or Python pipelines, training, registry, serving and drift monitoring. Export models as standalone APIs, or run them on Databricks with MLflow.
GitHub · Python · 48 stars · 8 forks · +1 stars in 24 hours · Trending score 0.55
-
5
nshkrdotcom/flowstone
Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.
GitHub · Elixir · 32 stars · 2 forks · +1 stars in 24 hours · Trending score 0.45
-
6
ozkary/data-engineering-mta-turnstile
Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis
GitHub · Jupyter Notebook · 34 stars · 7 forks · +1 stars in 24 hours · Trending score 0.45
-
7
dagster-io/skills
A collection of AI skills for working with Dagster
GitHub · Python · 219 stars · 16 forks · 0 stars in 24 hours · Trending score 0.21
-
8
GitBrincie212/ChronoGrapher
Powerful, developer-experience centric, blazingly fast and extensible job scheduler and workflow orchestration platform
GitHub · Rust · 12 stars · 4 forks · 0 stars in 24 hours · Trending score 0.09
-
9
slothflowlabs/duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
GitHub · Rust · 1,559 stars · 121 forks · −3 stars in 24 hours · Trending score 0.09
-
10
apache/incubator-graphar
An open source, standard data file format for graph data storage and retrieval.
GitHub · Java · 383 stars · 98 forks · −1 stars in 24 hours · Trending score 0.03
-
11
amrelsawalhi/obelisk
Self-hosted data platform and control plane. A Parquet lakehouse queried in-process by DuckDB, live Postgres federation in the same SQL, dbt, notebooks, and a built-in orchestrator on one machine, with no cloud tax.
GitHub · Python · 38 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00