Canari v3 - next gen Maltego framework for rapid remote and local transform development
A data and analytics engineering platform designed for real-time sports betting analytics.
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
Create data pipeline using Lambda architecture with Spark, Kafka, Airflow and Snowflake
This project implements an end-to-end techstack for a data platform, for local development.
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
Secondo progetto per il corso di Big Data durante A.A. 2020/2021. Progetto che si incentra sulla creazione di una architettura lambda per effettuare analisi streaming e batch su dati estratti dalla piattaforma Twitch.
End-to-end Lambda Architecture: Kafka → Spark Streaming → Delta Lake → Airflow → PostgreSQL → Grafana. Dockerized, runs on a laptop.
An HBase/HDFS/Spark cloud drive with distributed storage, Kafka event streaming, AI summaries and recommendations, and a Vue dashboard.
Data Pipeline for Electronic Health Records
PulseStream: Enterprise-grade real-time event streaming and analytical processing pipeline implementing Lambda architecture with Apache Kafka (KRaft), Apache Flink, Redis, MongoDB, PySpark, and Streamlit.
Production-grade demand forecasting & dynamic pricing on Spark, Kafka & Hadoop — Lambda architecture, 5-member orchestrated build, 100% free/open-source, zero-cost.
Python-based streaming analytics platform combining real-time metrics with batch historical analysis. Uses a Kafka-compatible event stream, Redis speed layer, and AWS S3 + Athena pipeline — a practical implementation of the Lambda Architecture.
Electrical Consumption Monitoring - Big Data Pipeline using Lambda Architecture in Python
GCP Lambda architecture with Batch (Parquet ETL) and Streaming (Pub/Sub → Dataflow → BigQuery).
Reconciliador batch↔stream para replicação CDC: audita destino vs origem e classifica cada divergência (in_progress / lost_delete / orphan_pk / lost_update). Demo executável e testada.
Architecture Big Data temps réel (Lambda, HDFS-first) pour l'analyse de signaux planétaires — Kafka, Hadoop, Spark, MongoDB
Real-time + batch ETL pipeline for e-commerce order analytics using Kafka, Spark Structured Streaming, Airflow, and a star-schema warehouse. Follows medallion architecture (bronze/silver/gold) on S3-compatible storage.
To associate your repository with the lambda-architecture topic, visit your repo's landing page and select "manage topics."