data-orchestration repositories

Trending repositories tagged data-orchestration, ranked by trending score. Updated daily.

  1. 1
    kestra-io/kestra

    Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

    GitHub · Java · 30,310 stars · 3,547 forks · +19 stars in 24 hours · Trending score 2.79

  2. 2
    cubefs/cubefs

    cloud-native distributed storage

    GitHub · Go · 5,700 stars · 721 forks · +6 stars in 24 hours · Trending score 1.60

  3. 3
    goldener-data/goldener

    Goldener - Make your data even more valuable - Open source data-centric orchestration for the full AI lifecycle

    GitHub · Python · 18 stars · 29 forks · 0 stars in 24 hours · Trending score 0.88

  4. 4
    flyingriverhorse/Kayra

    Visual MLOps you host yourself: canvas or Python pipelines, training, registry, serving and drift monitoring. Export models as standalone APIs, or run them on Databricks with MLflow.

    GitHub · Python · 48 stars · 8 forks · +1 stars in 24 hours · Trending score 0.55

  5. 5
    nshkrdotcom/flowstone

    Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.

    GitHub · Elixir · 32 stars · 2 forks · +1 stars in 24 hours · Trending score 0.45

  6. 6
    ozkary/data-engineering-mta-turnstile

    Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

    GitHub · Jupyter Notebook · 34 stars · 7 forks · +1 stars in 24 hours · Trending score 0.45

  7. 7
    dagster-io/skills

    A collection of AI skills for working with Dagster

    GitHub · Python · 219 stars · 16 forks · 0 stars in 24 hours · Trending score 0.21

  8. 8
    GitBrincie212/ChronoGrapher

    Powerful, developer-experience centric, blazingly fast and extensible job scheduler and workflow orchestration platform

    GitHub · Rust · 12 stars · 4 forks · 0 stars in 24 hours · Trending score 0.09

  9. 9
    slothflowlabs/duckle

    Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

    GitHub · Rust · 1,559 stars · 121 forks · −3 stars in 24 hours · Trending score 0.09

  10. 10
    apache/incubator-graphar

    An open source, standard data file format for graph data storage and retrieval.

    GitHub · Java · 383 stars · 98 forks · −1 stars in 24 hours · Trending score 0.03

  11. 11
    amrelsawalhi/obelisk

    Self-hosted data platform and control plane. A Parquet lakehouse queried in-process by DuckDB, live Postgres federation in the same SQL, dbt, notebooks, and a built-in orchestrator on one machine, with no cloud tax.

    GitHub · Python · 38 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00