parquet repositories

Trending repositories tagged parquet, ranked by trending score. Updated daily.

  1. 1
    datazip-inc/olake-go

    OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

    GitHub · Go · 2,173 stars · 322 forks · +163 stars in 24 hours · Trending score 4.18

  2. 2
    labstack/pitot

    Single-binary observability platform. Ingest OTLP, store as Parquet, query with DuckDB.

    GitHub · Go · 152 stars · 3 forks · +15 stars in 24 hours · Trending score 2.23

  3. 3
    caioricciuti/duck-ui

    The fully open-source DuckDB workbench that runs in your browser. SQL editor, notebooks, charts, AI assistant. No install, no signup, no backend — your data never leaves the tab.

    GitHub · TypeScript · 660 stars · 44 forks · +14 stars in 24 hours · Trending score 1.96

  4. 4
    apache/arrow

    Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

    GitHub · C++ · 17,326 stars · 4,474 forks · +5 stars in 24 hours · Trending score 1.91

  5. 5
    datafusion-contrib/liquid-cache

    Pushdown cache for DataFusion

    GitHub · Rust · 473 stars · 53 forks · +13 stars in 24 hours · Trending score 1.87

  6. 6
    rootSunc/CNEquity

    开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.

    GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.50

  7. 7
    tunjayoff/sofascore_scraper

    Self-hosted SofaScore data platform: follow leagues, teams, players and matches in 21 sports, download their history within a request budget, and export CSV, JSONL, Parquet or SQLite. Python library, ssc CLI, HTTP API and web UI. Unofficial.

    GitHub · Python · 54 stars · 16 forks · +2 stars in 24 hours · Trending score 1.25

  8. 8
    apache/arrow-rs

    Official Rust implementation of Apache Arrow

    GitHub · Rust · 3,676 stars · 1,452 forks · +1 stars in 24 hours · Trending score 1.24

  9. 9
    davanstrien/saturate

    Batch inference for datasets: rows in, any OpenAI-compatible endpoint, resumable parquet out. Congestion-aware concurrency — no tuning.

    GitHub · Python · 56 stars · 2 forks · +2 stars in 24 hours · Trending score 1.21

  10. 10
    jlruedab/clifr

    clifr is a Linux System Flight Recorder (SFR) that continuously captures processes, connections, open files and system counters, then shows accurate ps, ss, lsof, top (and 30+ other) tools' full-output for any past moment; tamper-proof and with very low-overhead.

    GitHub · Go · 16 stars · 2 forks · +9 stars in 24 hours · Trending score 1.20

  11. 11
    rilldata/rill

    The fastest business intelligence tool for humans and agents.

    GitHub · Go · 3,007 stars · 208 forks · +2 stars in 24 hours · Trending score 1.20

  12. 12
    yakisoba0728/vrfkit

    VALORANT replay (.vrf) parser and analysis toolkit — lossless, every value exported. Rust.

    GitHub · Rust · 31 stars · 14 forks · +2 stars in 24 hours · Trending score 1.17

  13. 13
    ara3d/bim-open-schema

    Representing BIM Data as Parquet

    GitHub · C# · 57 stars · 10 forks · +4 stars in 24 hours · Trending score 1.05

  14. 14
    GIScience/ohsome-planet

    Transform OSM (history) PBF files into GeoParquet. Enrich with OSM changeset metadata and country information.

    GitHub · Java · 64 stars · 7 forks · +4 stars in 24 hours · Trending score 1.05

  15. 15
    yashveeeeeeer/india-geodata

    Download India's open GIS data — district boundaries, electoral maps, census geometries, shapefiles, GeoJSON, Parquet. Includes India Map Maker, a free online map maker for India: spreadsheet in, state or district map out, no watermark.

    GitHub · Python · 93 stars · 21 forks · +2 stars in 24 hours · Trending score 1.05

  16. 16
    hardwood-hq/hardwood

    A fast minimal dependency implementation of Apache Parquet

    GitHub · Java · 426 stars · 102 forks · +2 stars in 24 hours · Trending score 1.05

  17. 17
    nao1215/filesql

    loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms

    GitHub · Go · 388 stars · 12 forks · +2 stars in 24 hours · Trending score 1.04

  18. 18
    Kuinox/Plank

    High-performance Parquet reader and writer for .NET

    GitHub · C# · 27 stars · 3 forks · +1 stars in 24 hours · Trending score 1.02

  19. 19
    questdb/questdb

    QuestDB is a high performance, open-source, time-series database

    GitHub · Java · 17,543 stars · 1,706 forks · 0 stars in 24 hours · Trending score 1.00

  20. 20
    aperiodic-io/tparquet

    Parquet for time series. Trade and tick files at about half their ZSTD size (0.49× on 139M trades from four market data providers), lossless, and still Parquet. > Backed by aperiodic.io

    GitHub · Rust · 51 stars · 4 forks · +4 stars in 24 hours · Trending score 0.83

  21. 21
    pacman82/odbc2parquet

    A command line tool to query an ODBC data source and write the result into a parquet file.

    GitHub · Rust · 258 stars · 21 forks · +2 stars in 24 hours · Trending score 0.81

  22. 22
    CrunchyData/pg_parquet

    Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

    GitHub · Rust · 696 stars · 40 forks · +2 stars in 24 hours · Trending score 0.81

  23. 23
    parquet-go/parquet-go

    High-performance Go package to read and write Parquet files

    GitHub · Go · 800 stars · 163 forks · −1 stars in 24 hours · Trending score 0.80

  24. 24
    viggy28/streambed

    Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol.

    GitHub · Go · 311 stars · 11 forks · +2 stars in 24 hours · Trending score 0.71