pipeline repositories

Trending repositories tagged pipeline, ranked by trending score. Updated daily.

  1. 1
    marimo-team/marimo

    A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

    GitHub · Python · 23,670 stars · 1,413 forks · +37 stars in 24 hours · Trending score 3.15

  2. 2
    data-infra/cube-studio

    cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持

    GitHub · Python · 2,615 stars · 224 forks · +65 stars in 24 hours · Trending score 3.10

  3. 3
    kestra-io/kestra

    Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

    GitHub · Java · 30,303 stars · 3,546 forks · +18 stars in 24 hours · Trending score 2.71

  4. 4
    argoproj/argo-cd

    Declarative Continuous Deployment for Kubernetes

    GitHub · Go · 24,669 stars · 8,104 forks · +27 stars in 24 hours · Trending score 2.69

  5. 5
    PrefectHQ/prefect

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    GitHub · Python · 24,202 stars · 2,675 forks · +13 stars in 24 hours · Trending score 2.44

  6. 6
    rvion/comfy-ts

    comfy-ts: the complete TypeScript toolkit for ComfyUI and generative AI. Fully type-safe SDK with autocomplete on every node, companion CLI, TUI, agentic docs, and 80+ examples. Design, run and deploy creative pipelines for image, video, audio, 3d and text on any ComfyUI, local, cloud or hosted.

    GitHub · TypeScript · 24 stars · 5 forks · +11 stars in 24 hours · Trending score 2.05

  7. 7
    hexsyro/HonestyPipeline

    Orchestrate 8 data-quality audits into one pipeline and package the results with a data-health score, datasheet, and report.

    GitHub · Python · 77 stars · 1 forks · +9 stars in 24 hours · Trending score 1.69

  8. 8
    projectdiscovery/httpx

    httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

    GitHub · Go · 10,633 stars · 1,133 forks · +2 stars in 24 hours · Trending score 1.64

  9. 9
    yimwoo/codex-agenteam

    AI team for Codex — researcher, PM, architect, developer, QA, and reviewer orchestrated through a configurable pipeline.

    GitHub · Python · 15 stars · 2 forks · +7 stars in 24 hours · Trending score 1.50

  10. 10
    airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    GitHub · Python · 22,411 stars · 5,550 forks · 0 stars in 24 hours · Trending score 1.47

  11. 11
    kubeflow/pipelines

    Machine Learning Pipelines for Kubeflow

    GitHub · Python · 4,268 stars · 2,209 forks · +2 stars in 24 hours · Trending score 1.36

  12. 12
    JuliaAI/MLJ.jl

    A Julia machine learning framework

    GitHub · Julia · 1,948 stars · 160 forks · +6 stars in 24 hours · Trending score 1.30

  13. 13
    apache/hop

    Hop Orchestration Platform

    GitHub · Java · 1,544 stars · 493 forks · +2 stars in 24 hours · Trending score 1.28

  14. 14
    huangchengsir/pipewright

    Lightweight self-hosted CI/CD + deployment + ops platform in a single Go binary | 轻量自托管 CI/CD·部署·运维一体化平台,单二进制零依赖

    GitHub · Go · 164 stars · 40 forks · +2 stars in 24 hours · Trending score 1.28

  15. 15
    kestra-io/docs

    Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

    GitHub · Astro · 193 stars · 214 forks · +1 stars in 24 hours · Trending score 1.21

  16. 16
    andreapollastri/checkpoint

    Laravel Security Tool

    GitHub · PHP · 127 stars · 2 forks · +4 stars in 24 hours · Trending score 1.14

  17. 17
    nf-core/differentialabundance

    Differential abundance analysis for feature/ observation matrices from platforms such as RNA-seq

    GitHub · Nextflow · 98 stars · 69 forks · +3 stars in 24 hours · Trending score 1.14

  18. 18
    GeiserX/OwnGenome

    Whole genome sequencing analysis pipeline for consumer hardware. 100% local, Docker-powered, free and open source.

    GitHub · Rust · 28 stars · 6 forks · +2 stars in 24 hours · Trending score 1.10

  19. 19
    tektoncd/pipeline

    A cloud-native Pipeline resource.

    GitHub · Go · 9,110 stars · 1,982 forks · +1 stars in 24 hours · Trending score 1.10

  20. 20
    nasa/ziggy

    Ziggy, a portable, scalable infrastructure for science data processing pipelines, is the child of the Transiting Exoplanet Survey Satellite (TESS) pipeline and the grandchild of the Kepler Pipeline.

    GitHub · Java · 31 stars · 7 forks · +3 stars in 24 hours · Trending score 1.01

  21. 21
    temple-compute/horus-runtime

    Run reproducible scientific workflows anywhere (laptop, remote, or HPC cluster) from a single YAML file. The open-source runtime behind Temple Compute.

    GitHub · Python · 49 stars · 3 forks · +1 stars in 24 hours · Trending score 0.94

  22. 22
    CodefyUI/CodefyUI

    A visual, node-based deep learning pipeline builder for education. Design CNN, RNN, Transformer, and RL architectures by dragging and connecting nodes — no boilerplate code needed.

    GitHub · Python · 20 stars · 11 forks · +2 stars in 24 hours · Trending score 0.88

  23. 23
    google/xls

    XLS: Accelerated HW Synthesis

    GitHub · C++ · 1,991 stars · 328 forks · 0 stars in 24 hours · Trending score 0.82

  24. 24
    HOBOBO/AbilityKit

    面向中大型战斗项目设计的模块化游戏战斗工具集,提供数据驱动的技能管线、事件触发规则、战斗运行时与多种网络同步能力。可用于构建技能系统等。核心逻辑采用纯 C#,可按需组合并运行于 Unity、服务器及测试环境。

    GitHub · C# · 295 stars · 58 forks · +1 stars in 24 hours · Trending score 0.79