parquet repositories
Trending repositories tagged parquet, ranked by trending score. Updated daily.
-
1
datazip-inc/olake-go
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
GitHub · Go · 2,173 stars · 322 forks · +163 stars in 24 hours · Trending score 4.18
-
2
labstack/pitot
Single-binary observability platform. Ingest OTLP, store as Parquet, query with DuckDB.
GitHub · Go · 152 stars · 3 forks · +15 stars in 24 hours · Trending score 2.23
-
3
caioricciuti/duck-ui
The fully open-source DuckDB workbench that runs in your browser. SQL editor, notebooks, charts, AI assistant. No install, no signup, no backend — your data never leaves the tab.
GitHub · TypeScript · 660 stars · 44 forks · +14 stars in 24 hours · Trending score 1.96
-
4
apache/arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
GitHub · C++ · 17,326 stars · 4,474 forks · +5 stars in 24 hours · Trending score 1.91
-
5
datafusion-contrib/liquid-cache
Pushdown cache for DataFusion
GitHub · Rust · 473 stars · 53 forks · +13 stars in 24 hours · Trending score 1.87
-
6
rootSunc/CNEquity
开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.
GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.50
-
7
tunjayoff/sofascore_scraper
Self-hosted SofaScore data platform: follow leagues, teams, players and matches in 21 sports, download their history within a request budget, and export CSV, JSONL, Parquet or SQLite. Python library, ssc CLI, HTTP API and web UI. Unofficial.
GitHub · Python · 54 stars · 16 forks · +2 stars in 24 hours · Trending score 1.25
-
8
apache/arrow-rs
Official Rust implementation of Apache Arrow
GitHub · Rust · 3,676 stars · 1,452 forks · +1 stars in 24 hours · Trending score 1.24
-
9
davanstrien/saturate
Batch inference for datasets: rows in, any OpenAI-compatible endpoint, resumable parquet out. Congestion-aware concurrency — no tuning.
GitHub · Python · 56 stars · 2 forks · +2 stars in 24 hours · Trending score 1.21
-
10
jlruedab/clifr
clifr is a Linux System Flight Recorder (SFR) that continuously captures processes, connections, open files and system counters, then shows accurate ps, ss, lsof, top (and 30+ other) tools' full-output for any past moment; tamper-proof and with very low-overhead.
GitHub · Go · 16 stars · 2 forks · +9 stars in 24 hours · Trending score 1.20
-
11
rilldata/rill
The fastest business intelligence tool for humans and agents.
GitHub · Go · 3,007 stars · 208 forks · +2 stars in 24 hours · Trending score 1.20
-
12
yakisoba0728/vrfkit
VALORANT replay (.vrf) parser and analysis toolkit — lossless, every value exported. Rust.
GitHub · Rust · 31 stars · 14 forks · +2 stars in 24 hours · Trending score 1.17
-
13
ara3d/bim-open-schema
Representing BIM Data as Parquet
GitHub · C# · 57 stars · 10 forks · +4 stars in 24 hours · Trending score 1.05
-
14
GIScience/ohsome-planet
Transform OSM (history) PBF files into GeoParquet. Enrich with OSM changeset metadata and country information.
GitHub · Java · 64 stars · 7 forks · +4 stars in 24 hours · Trending score 1.05
-
15
yashveeeeeeer/india-geodata
Download India's open GIS data — district boundaries, electoral maps, census geometries, shapefiles, GeoJSON, Parquet. Includes India Map Maker, a free online map maker for India: spreadsheet in, state or district map out, no watermark.
GitHub · Python · 93 stars · 21 forks · +2 stars in 24 hours · Trending score 1.05
-
16
hardwood-hq/hardwood
A fast minimal dependency implementation of Apache Parquet
GitHub · Java · 426 stars · 102 forks · +2 stars in 24 hours · Trending score 1.05
-
17
nao1215/filesql
loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms
GitHub · Go · 388 stars · 12 forks · +2 stars in 24 hours · Trending score 1.04
-
18
Kuinox/Plank
High-performance Parquet reader and writer for .NET
GitHub · C# · 27 stars · 3 forks · +1 stars in 24 hours · Trending score 1.02
-
19
questdb/questdb
QuestDB is a high performance, open-source, time-series database
GitHub · Java · 17,543 stars · 1,706 forks · 0 stars in 24 hours · Trending score 1.00
-
20
aperiodic-io/tparquet
Parquet for time series. Trade and tick files at about half their ZSTD size (0.49× on 139M trades from four market data providers), lossless, and still Parquet. > Backed by aperiodic.io
GitHub · Rust · 51 stars · 4 forks · +4 stars in 24 hours · Trending score 0.83
-
21
pacman82/odbc2parquet
A command line tool to query an ODBC data source and write the result into a parquet file.
GitHub · Rust · 258 stars · 21 forks · +2 stars in 24 hours · Trending score 0.81
-
22
CrunchyData/pg_parquet
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
GitHub · Rust · 696 stars · 40 forks · +2 stars in 24 hours · Trending score 0.81
-
23
parquet-go/parquet-go
High-performance Go package to read and write Parquet files
GitHub · Go · 800 stars · 163 forks · −1 stars in 24 hours · Trending score 0.80
-
24
viggy28/streambed
Stream Postgres to Apache Iceberg on S3 via logical replication, queryable over the Postgres wire protocol.
GitHub · Go · 311 stars · 11 forks · +2 stars in 24 hours · Trending score 0.71