datalake repositories

Trending repositories tagged datalake, ranked by trending score. Updated daily.

  1. 1
    apache/gravitino

    World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

    GitHub · Java · 3,404 stars · 999 forks · +12 stars in 24 hours · Trending score 2.33

  2. 2
    StarRocks/starrocks

    The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

    GitHub · Java · 12,272 stars · 2,684 forks · +9 stars in 24 hours · Trending score 2.19

  3. 3
    trinodb/trino

    Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

    GitHub · Java · 13,529 stars · 3,882 forks · +8 stars in 24 hours · Trending score 2.11

  4. 4
    ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99

  5. 5
    nisshi-io/solace-nisshi

    Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

    GitHub · Rust · 1,934 stars · 87 forks · +1 stars in 24 hours · Trending score 0.80

  6. 6
    apache/hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    GitHub · Java · 6,386 stars · 2,545 forks · 0 stars in 24 hours · Trending score 0.79

  7. 7
    awslabs/visual-asset-management-system

    Visual Asset Management System (VAMS) is a purpose-built, AWS native accelerator solution for the management and distribution of traditional to specialized visual assets used in physical AI and spatial computing.

    GitHub · Python · 152 stars · 60 forks · 0 stars in 24 hours · Trending score 0.76

  8. 8
    treeverse/lakeFS

    lakeFS - Data version control for your data lake | Git for data

    GitHub · Go · 5,586 stars · 493 forks · −3 stars in 24 hours · Trending score 0.72

  9. 9
    linkedin/openhouse

    Open Control Plane for Tables in Data Lakehouse

    GitHub · Java · 405 stars · 86 forks · 0 stars in 24 hours · Trending score 0.33

  10. 10
    apache/doris-thirdparty

    Self-managed thirdparty dependencies for Apache Doris

    GitHub · 52 stars · 69 forks · 0 stars in 24 hours · Trending score 0.32

  11. 11
    apache/doris-website

    Apache Doris Website

    GitHub · MDX · 137 stars · 490 forks · 0 stars in 24 hours · Trending score 0.29

  12. 12
    buoyant-data/oxbow

    Collection of AWS Lambdas for creating and managing Delta tables

    GitHub · Rust · 59 stars · 11 forks · 0 stars in 24 hours · Trending score 0.22

  13. 13
    exasol-labs/lakehouse-engine-rs

    In-place query engine for Lakehouses (Iceberg and Delta Lake) for Exasol. Written in Rust 🦀

    GitHub · Rust · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  14. 14
    DataLinkDC/dinky

    Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

    GitHub · Java · 3,776 stars · 1,354 forks · 0 stars in 24 hours · Trending score 0.08

  15. 15
    j2h4u/mcp-telegram

    MCP server exposing Telegram as tools for LLMs — read history, search with context, look up entities by name

    GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.05

  16. 16
    hyparam/icebird

    Icebird: JavaScript Iceberg Client

    GitHub · JavaScript · 131 stars · 8 forks · 0 stars in 24 hours · Trending score 0.02

  17. 17
    samber/awesome-olap

    🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.

    GitHub · Astro · 151 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02

  18. 18
    SkardiLabs/skardi

    Skardi is a self-improving context framework for ai agents

    GitHub · Rust · 111 stars · 10 forks · 0 stars in 24 hours · Trending score 0.02

  19. 19
    HKUSTDial/awesome-data-agents

    Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"

    GitHub · Python · 800 stars · 62 forks · 0 stars in 24 hours · Trending score 0.02

  20. 20
    DataWithBaraa/sql-data-warehouse-project

    A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.

    GitHub · TSQL · 1,062 stars · 750 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    nimtable/iceberg-compaction

    Compaction runtime for Apache Iceberg.

    GitHub · Rust · 145 stars · 31 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    zinggAI/zingg

    Scalable master data management, identity resolution, entity resolution, and deduplication using ML

    GitHub · Java · 1,256 stars · 178 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    neuralinkcorp/datarepo

    GitHub · Python · 203 stars · 43 forks · 0 stars in 24 hours · Trending score 0.00