Build software better, together

pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

python rust streaming real-time kafka etl machine-learning-algorithms stream-processing data-analytics dataflow data-processing data-pipelines batch-processing pathway iot-analytics etl-framework time-series-analysis

Updated Oct 2, 2026
Python

robinhood / faust

Star

Python Stream Processing

python distributed-systems kafka stream-processing asyncio kafka-streams

Updated Jul 27, 2024
Python

online-ml / river

Star

🌊 Online machine learning in Python

python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics

Updated Oct 2, 2026
Python

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

python redis mqtt distributed-systems kafka rabbitmq nats stream-processing mqtt-broker asyncio event-driven-architecture asyncapi faststream

Updated Oct 2, 2026
Python

douban / dpark

Star

Python clone of Spark, a MapReduce alike framework in Python

python spark bigdata stream-processing mapreduce dpark

Updated Dec 25, 2020
Python

bytewax / bytewax

Star

Python Stream Processing

python rust data-science machine-learning stream-processing data-engineering dataflow data-processing streaming-data

Updated Jun 20, 2026
Python

nerevu / riko

Star

A Python stream processing engine modeled after Yahoo! Pipes

cli rss data library etl functional-programming asynchronous parallelism stream-processing featured

Updated Oct 1, 2026
Python

quixio / quix-streams

Star

Python Streaming DataFrames for Kafka

python data-science machine-learning kafka stream-processing data-engineering streaming-data stream-processor event-driven-architecture streaming-data-processing time-series-data data-intensive-applications streaming-data-pipelines real-time-data-processing

Updated Oct 1, 2026
Python

dpnkrpl / radio-active

Sponsor

Star

Play any radios around the globe right from the terminal ⚡

audio radio music cli streaming music-player stream-processing music-bot online-radio shazam stations commandline-interface radioplayer radio-player pyradios pyradio favorite-station

Updated Oct 1, 2026
Python

Point72 / csp

Star

csp is a high performance reactive stream processing library, written in C++ and Python

python streaming reactive cpp reactive-programming stream-processing

Updated Oct 1, 2026
Python

mjwestcott / runnel

Star

Distributed event processing for Python based on Redis Streams

python redis data task queue async job event-sourcing stream-processing asyncio background redis-streams

Updated Aug 27, 2020
Python

devshawn / kafka-shell

Star

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

shell cli terminal kafka apache prompt streams stream-processing confluent kafka-cli kafka-tools

Updated Feb 11, 2020
Python

wso2 / product-sp

Star

An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses

analytics stream-processing complex-event-processing real-time-processing streaming-data-integration

Updated Dec 1, 2021
Python

zefhub / zef

Star

Toolkit for graph-relational data across space and time

Updated Jan 28, 2026
Python

wso2 / product-integrator-si

Star

A stream processing runtime that allows connecting any streaming data source to any destination and act on it

real-time integration wso2 stream-processing event-driven cloud-native streaming-data siddhi streaming-integration

Updated Oct 2, 2026
Python

bytedance / Elkeid-HUB

Star

Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.

rule-engine stream-processing soar ruleengine event-engine