data-platform repositories

Trending repositories tagged data-platform, ranked by trending score. Updated daily.

  1. 1
    qiantongtech/qData

    qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.

    GitHub · Java · 940 stars · 140 forks · +21 stars in 24 hours · Trending score 2.59

  2. 2
    ssanjaychandra123/data-engineering-patterns

    600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.

    GitHub · 93 stars · 39 forks · +10 stars in 24 hours · Trending score 1.67

  3. 3
    bruin-data/bruin

    Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

    GitHub · Go · 1,816 stars · 100 forks · +6 stars in 24 hours · Trending score 1.55

  4. 4
    yuyuejia/datay

    DataY 是一套轻量、高性能的数据平台,一个 JAR、自研流批一体处理引擎,自研分布式调度框架,在 2 核 4G 的机器上 就能跑通 数据集成 → 数据建模 → 数据开发 → 任务调度 → 数据应用 的完整链路。

    GitHub · Java · 50 stars · 23 forks · +2 stars in 24 hours · Trending score 1.28

  5. 5
    clidey/whodb

    Where data access meets operational intelligence

    GitHub · Go · 5,061 stars · 243 forks · +2 stars in 24 hours · Trending score 1.04

  6. 6
    stardelt/stardelt

    The open-source data platform you actually own: SQL over Iceberg, notebooks, pipelines and dashboards on any Kubernetes cluster.

    GitHub · Rust · 13 stars · 0 forks · +6 stars in 24 hours · Trending score 1.02

  7. 7
    mosaico-labs/mosaico

    Mosaico - The data platform for Physical AI

    GitHub · Python · 1,150 stars · 83 forks · 0 stars in 24 hours · Trending score 0.69

  8. 8
    tunjayoff/sofascore_scraper

    Self-hosted SofaScore data platform: follow leagues, teams, players and matches in 21 sports, download their history within a request budget, and export CSV, JSONL, Parquet or SQLite. Python library, ssc CLI, HTTP API and web UI. Unofficial.

    GitHub · Python · 53 stars · 16 forks · 0 stars in 24 hours · Trending score 0.62

  9. 9
    Data-Masterclass/sovereign-agentic-os

    Sovereign Agentic OS — self-hostable, EU-sovereign agentic data platform on Kubernetes (pre-beta). One Helm chart, runs in your own cluster.

    GitHub · TypeScript · 6 stars · 7 forks · +1 stars in 24 hours · Trending score 0.56

  10. 10
    RonaldHensbergen/composable-data-stack

    Modular data platform building blocks wired through explicit contracts, not hidden dependencies

    GitHub · Python · 8 stars · 14 forks · 0 stars in 24 hours · Trending score 0.38

  11. 11
    renart-data/renart

    Open source data platform for SQL and Python pipelines, notebooks and dashboards, with type checking, scheduling and definitions in Git.

    GitHub · Go · 96 stars · 8 forks · 0 stars in 24 hours · Trending score 0.37

  12. 12
    rocky-data/rocky

    A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.

    GitHub · Rust · 311 stars · 19 forks · 0 stars in 24 hours · Trending score 0.32

  13. 13
    canonical/opensearch-operator

    Operator charms for OpenSearch on VM and K8s

    GitHub · HCL · 18 stars · 20 forks · 0 stars in 24 hours · Trending score 0.25

  14. 14
    egret-data/platform

    Open-source, multi-tenant data platform: isolated workspaces with BI, Data API, workflows and data apps on a shared Iceberg lakehouse, with access policy enforced in Trino and StarRocks. Written in Rust.

    GitHub · Rust · 26 stars · 1 forks · 0 stars in 24 hours · Trending score 0.23

  15. 15
    debezium/debezium-platform

    An opinionated data-centric view of Debezium components. Please log issues at https://github.com/debezium/dbz/issues.

    GitHub · TypeScript · 55 stars · 45 forks · 0 stars in 24 hours · Trending score 0.19

  16. 16
    canonical/mongodb-operator

    Operator charm for MongoDB on VM

    GitHub · HCL · 14 stars · 17 forks · 0 stars in 24 hours · Trending score 0.19

  17. 17
    Jiahong-Que-9527/SoloLakehouse

    A Git-first Data & AI engineering initiative across Google Cloud, Databricks, and self-hosted infrastructure. One source of truth for independent projects, reproducible workflows, and automated delivery.

    GitHub · Python · 63 stars · 13 forks · 0 stars in 24 hours · Trending score 0.18

  18. 18
    stackabletech/hdfs-operator

    Kubernetes operator for Apache Hadoop HDFS. Deploy and run HDFS NameNodes, DataNodes and JournalNodes with the Stackable Data Platform (SDP).

    GitHub · Rust · 53 stars · 10 forks · 0 stars in 24 hours · Trending score 0.10

  19. 19
    stackabletech/trino-operator

    Kubernetes operator for Trino. Deploy and run Trino coordinators and workers with the Stackable Data Platform (SDP).

    GitHub · Rust · 64 stars · 15 forks · 0 stars in 24 hours · Trending score 0.09

  20. 20
    getdango/dango

    Open-source data platform for small teams.

    GitHub · Python · 13 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08

  21. 21
    stackabletech/spark-k8s-operator

    Kubernetes operator for Apache Spark. Run Spark applications on Kubernetes with the Stackable Data Platform (SDP).

    GitHub · Rust · 74 stars · 6 forks · 0 stars in 24 hours · Trending score 0.08

  22. 22
    ostrium-labs/loams

    One bucket, every index: open-source, AI-native data platform in Rust. Hybrid retrieval on object storage, plus reactive data (Live), graph, SQL, Postgres and durable agent runs. Preview.

    GitHub · Rust · 38 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  23. 23
    keboola/mcp-server

    Model Context Protocol (MCP) Server for the Keboola Platform

    GitHub · Python · 85 stars · 23 forks · 0 stars in 24 hours · Trending score 0.02

  24. 24
    opendatadiscovery/odd-platform

    First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

    GitHub · Java · 1,441 stars · 152 forks · 0 stars in 24 hours · Trending score 0.00