stream-processing repositories

Trending repositories tagged stream-processing, ranked by trending score. Updated daily.

  1. 1
    vectordotdev/vector

    A high-performance observability data pipeline.

    GitHub · Rust · 22,922 stars · 2,406 forks · +22 stars in 24 hours · Trending score 2.78

  2. 2
    google-ai-edge/mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    GitHub · C++ · 37,760 stars · 6,238 forks · +13 stars in 24 hours · Trending score 2.54

  3. 3
    fluent/fluent-bit

    Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows

    GitHub · C · 8,200 stars · 2,041 forks · +16 stars in 24 hours · Trending score 2.26

  4. 4
    risingwavelabs/risingwave

    Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

    GitHub · Rust · 9,425 stars · 870 forks · +7 stars in 24 hours · Trending score 1.85

  5. 5
    p2panda/p2panda

    All the things a panda needs

    GitHub · Rust · 602 stars · 53 forks · +3 stars in 24 hours · Trending score 1.35

  6. 6
    questdb/questdb

    QuestDB is a high performance, open-source, time-series database

    GitHub · Java · 17,543 stars · 1,705 forks · +1 stars in 24 hours · Trending score 1.34

  7. 7
    manuzhang/awesome-streaming

    a curated list of awesome streaming frameworks, applications, etc

    GitHub · JavaScript · 3,037 stars · 333 forks · +3 stars in 24 hours · Trending score 1.30

  8. 8
    SinapsisHub/sinapsis-hub

    A single contract for the AI ecosystem

    GitHub · Python · 54 stars · 14 forks · +12 stars in 24 hours · Trending score 1.27

  9. 9
    MaterializeInc/materialize

    The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

    GitHub · Rust · 6,407 stars · 519 forks · +2 stars in 24 hours · Trending score 1.19

  10. 10
    timescale/rsigma

    A complete Sigma detection engineering toolkit: parser, linter, formatter, evaluator, correlation engine, conversion framework, streaming daemon, MCP and LSP servers :crab:

    GitHub · Rust · 193 stars · 21 forks · +2 stars in 24 hours · Trending score 1.14

  11. 11
    timeplus-io/proton

    The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

    GitHub · C++ · 2,286 stars · 112 forks · +3 stars in 24 hours · Trending score 1.10

  12. 12
    StreamIntelligenceLab/Kolibrie

    A SPARQL database, RDF Stream Processing Engine and RDF toolkit, supporting Neurosymbolic Stream Reasoning

    GitHub · Rust · 65 stars · 13 forks · +2 stars in 24 hours · Trending score 0.97

  13. 13
    Point72/csp

    csp is a high performance reactive stream processing library, written in C++ and Python

    GitHub · Python · 479 stars · 93 forks · 0 stars in 24 hours · Trending score 0.93

  14. 14
    redpanda-data/connect

    Fancy stream processing made operationally mundane

    GitHub · Go · 8,804 stars · 985 forks · +1 stars in 24 hours · Trending score 0.83

  15. 15
    ag2ai/faststream

    Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

    GitHub · Python · 5,396 stars · 427 forks · 0 stars in 24 hours · Trending score 0.80

  16. 16
    apache/hudi

    Upserts, Deletes And Incremental Processing on Big Data.

    GitHub · Java · 6,386 stars · 2,545 forks · 0 stars in 24 hours · Trending score 0.79

  17. 17
    wso2/product-integrator-si

    A stream processing runtime that allows connecting any streaming data source to any destination and act on it

    GitHub · Python · 133 stars · 57 forks · 0 stars in 24 hours · Trending score 0.72

  18. 18
    ThreeDotsLabs/watermill

    Building event-driven applications the easy way in Go.

    GitHub · Go · 9,969 stars · 516 forks · +3 stars in 24 hours · Trending score 0.71

  19. 19
    hazelcast/hazelcast

    Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

    GitHub · Java · 6,637 stars · 1,912 forks · +1 stars in 24 hours · Trending score 0.70

  20. 20
    Sekelenao/Flinkboot

    The Bootstrapping & Reliability Framework for Apache Flink. Fail fast on configuration, serialize natively without Kryo, and bootstrap stream pipelines with zero boilerplate.

    GitHub · Java · 11 stars · 41 forks · 0 stars in 24 hours · Trending score 0.64

  21. 21
    oxnr/awesome-bigdata

    A curated list of awesome big data frameworks, ressources and other awesomeness.

    GitHub · 14,738 stars · 2,585 forks · 0 stars in 24 hours · Trending score 0.63

  22. 22
    ewiger/hql

    HQL — Hyper Query Language — is a strongly typed language for querying, transforming, connecting and computing over data, knowledge and AI workflows.

    GitHub · Rust · 6 stars · 1 forks · +1 stars in 24 hours · Trending score 0.54

  23. 23
    PeerDB-io/peerdb

    Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

    GitHub · Go · 3,322 stars · 235 forks · −1 stars in 24 hours · Trending score 0.47

  24. 24
    apache/streampipes

    Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

    GitHub · Java · 763 stars · 253 forks · 0 stars in 24 hours · Trending score 0.42