data-integration repositories

Trending repositories tagged data-integration, ranked by trending score. Updated daily.

  1. 1
    apache/airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    GitHub · Python · 47,569 stars · 18,419 forks · +46 stars in 24 hours · Trending score 3.37

  2. 2
    HelixDB/helix-foundry

    Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.

    GitHub · Go · 2,173 stars · 313 forks · +31 stars in 24 hours · Trending score 2.74

  3. 3
    qiantongtech/qData

    qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.

    GitHub · Java · 940 stars · 140 forks · +21 stars in 24 hours · Trending score 2.59

  4. 4
    dagster-io/dagster

    An orchestration platform for the development, production, and observation of data assets.

    GitHub · Python · 16,444 stars · 2,427 forks · +9 stars in 24 hours · Trending score 2.36

  5. 5
    airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32

  6. 6
    apache/seatunnel

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    GitHub · Java · 9,819 stars · 2,471 forks · +6 stars in 24 hours · Trending score 1.96

  7. 7
    morph-kgc/morph-kgc

    Powerful RDF knowledge graph generation with RML mappings

    GitHub · Python · 303 stars · 62 forks · +8 stars in 24 hours · Trending score 1.62

  8. 8
    apache/hop

    Hop Orchestration Platform

    GitHub · Java · 1,543 stars · 493 forks · +4 stars in 24 hours · Trending score 1.59

  9. 9
    apache/devlake

    Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

    GitHub · Go · 3,204 stars · 842 forks · +5 stars in 24 hours · Trending score 1.50

  10. 10
    oracle-samples/oracle-aidp-samples

    Oracle AI Data Platform Workbench Samples

    GitHub · Python · 61 stars · 44 forks · +5 stars in 24 hours · Trending score 1.46

  11. 11
    bruin-data/ingestr

    ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

    GitHub · Go · 4,048 stars · 170 forks · +5 stars in 24 hours · Trending score 1.34

  12. 12
    jitsucom/jitsu

    Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

    GitHub · TypeScript · 5,137 stars · 405 forks · +1 stars in 24 hours · Trending score 1.25

  13. 13
    galaxy-io/filament

    Pluggable data replication with checkpointing, batching, and integrity events

    GitHub · Go · 335 stars · 47 forks · 0 stars in 24 hours · Trending score 1.06

  14. 14
    clidey/whodb

    Where data access meets operational intelligence

    GitHub · Go · 5,061 stars · 243 forks · +2 stars in 24 hours · Trending score 1.04

  15. 15
    TonyWang-hub/mcp-cn-commerce

    中国电商 MCP 连接器:8 个平台、155 个已注册工具。开源标准版,含能力矩阵与实际工程验收记录;真实商家联调状态逐项公开。Chinese commerce MCP connectors with documented capabilities and validation status.

    GitHub · Python · 101 stars · 18 forks · 0 stars in 24 hours · Trending score 0.88

  16. 16
    RhinoLink-Tech/data-fabric

    Data Fabric is a lightweight, self-hosted gateway for unified management and access across heterogeneous data sources.

    GitHub · Go · 22 stars · 21 forks · 0 stars in 24 hours · Trending score 0.80

  17. 17
    apache/hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    GitHub · Java · 6,386 stars · 2,545 forks · 0 stars in 24 hours · Trending score 0.79

  18. 18
    estuary/flow

    🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊

    GitHub · Rust · 992 stars · 101 forks · +1 stars in 24 hours · Trending score 0.73

  19. 19
    armbian/armbian.github.io

    This repository serves as the central automation, orchestration, and data backbone for the Armbian project’s CI/CD infrastructure. It manages and publishes critical workflows, build artifacts, metadata, and machine-readable content that power Armbian’s public services and infrastructure.

    GitHub · Python · 15 stars · 70 forks · +1 stars in 24 hours · Trending score 0.65

  20. 20
    cloudquery/cloudquery

    Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

    GitHub · Go · 6,560 stars · 566 forks · +1 stars in 24 hours · Trending score 0.61

  21. 21
    apache/flink-cdc

    Flink CDC is a streaming data integration tool

    GitHub · Java · 6,495 stars · 2,209 forks · +1 stars in 24 hours · Trending score 0.56

  22. 22
    ewiger/hql

    HQL — Hyper Query Language — is a strongly typed language for querying, transforming, connecting and computing over data, knowledge and AI workflows.

    GitHub · Rust · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.54

  23. 23
    faucet-hq/faucet-stream

    The fast, config-driven way to move data in Rust — a native CLI and an embeddable Rust ETL library

    GitHub · Rust · 23 stars · 8 forks · +1 stars in 24 hours · Trending score 0.54

  24. 24
    seandavi/awesome-single-cell

    Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

    GitHub · 3,894 stars · 1,100 forks · 0 stars in 24 hours · Trending score 0.43