data-engineering repositories
Trending repositories tagged data-engineering, ranked by trending score. Updated daily.
-
1
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
GitHub · Python · 47,569 stars · 18,419 forks · +46 stars in 24 hours · Trending score 3.37
-
2
DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
GitHub · Jupyter Notebook · 46,985 stars · 9,082 forks · +36 stars in 24 hours · Trending score 3.25
-
3
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
GitHub · Python · 75,586 stars · 18,641 forks · +37 stars in 24 hours · Trending score 3.16
-
4
kestra-io/kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
GitHub · Java · 30,292 stars · 3,544 forks · +34 stars in 24 hours · Trending score 3.01
-
5
growthbook/growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
GitHub · TypeScript · 8,632 stars · 913 forks · +26 stars in 24 hours · Trending score 2.77
-
6
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
GitHub · Python · 24,190 stars · 2,671 forks · +16 stars in 24 hours · Trending score 2.48
-
7
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
GitHub · Python · 16,444 stars · 2,427 forks · +9 stars in 24 hours · Trending score 2.36
-
8
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32
-
9
GokuMohandas/Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19
-
10
risingwavelabs/risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
GitHub · Rust · 9,425 stars · 868 forks · +7 stars in 24 hours · Trending score 1.85
-
11
argoproj/argo-workflows
Workflow Engine for Kubernetes
GitHub · Go · 17,107 stars · 3,741 forks · +5 stars in 24 hours · Trending score 1.81
-
12
Kaelio/ktx
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI agents to query analytical databases accurately and with full context of your company
GitHub · TypeScript · 1,632 stars · 113 forks · +8 stars in 24 hours · Trending score 1.79
-
13
ssanjaychandra123/data-engineering-patterns
600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.
GitHub · 93 stars · 39 forks · +10 stars in 24 hours · Trending score 1.67
-
14
morph-kgc/morph-kgc
Powerful RDF knowledge graph generation with RML mappings
GitHub · Python · 303 stars · 62 forks · +8 stars in 24 hours · Trending score 1.62
-
15
semantica-agi/semantica
Graph-Native Semantic Layer for Trustworthy Enterprise AI
GitHub · Python · 14,639 stars · 1,737 forks · 0 stars in 24 hours · Trending score 1.55
-
16
apache/devlake
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
GitHub · Go · 3,204 stars · 842 forks · +5 stars in 24 hours · Trending score 1.50
-
17
oracle-samples/oracle-aidp-samples
Oracle AI Data Platform Workbench Samples
GitHub · Python · 61 stars · 44 forks · +5 stars in 24 hours · Trending score 1.46
-
18
cocoindex-io/cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
GitHub · Rust · 11,918 stars · 930 forks · +3 stars in 24 hours · Trending score 1.34
-
19
DataWithBaraa/claude-code-data-engineering-skills
16 Claude Code skills for data engineers: profile a new source, investigate a failed run, review a change, document the platform. Most end in a page you can share.
GitHub · HTML · 106 stars · 38 forks · +2 stars in 24 hours · Trending score 1.27
-
20
bitol-io/open-data-contract-standard
Home of the Open Data Contract Standard (ODCS).
GitHub · Shell · 1,234 stars · 103 forks · +1 stars in 24 hours · Trending score 1.13
-
21
RyanJHamby/stock-screener
Automated stock screener scanning 3,800+ stocks daily for confirmed Stage 2 uptrends passing 8 strict criteria. Features: smart caching (74% fewer API calls), market regime filtering, automated stop-loss calculation, and GitHub Actions automation. Follows Mark Minervini's Trend Template.
GitHub · Python · 73 stars · 58 forks · 0 stars in 24 hours · Trending score 1.11
-
22
dlt-hub/dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
GitHub · Python · 6,098 stars · 664 forks · 0 stars in 24 hours · Trending score 1.09
-
23
DataRecce/recce
The data-validation toolkit for enhanced dbt (data build tool) PR review
GitHub · TypeScript · 484 stars · 31 forks · +3 stars in 24 hours · Trending score 1.09
-
24
exmergo/dex
Dex lets your agent build your analytics.
GitHub · Python · 136 stars · 70 forks · 0 stars in 24 hours · Trending score 1.07