Big Data serverless application
-
Updated
Feb 15, 2020 - Python
#
lambda-architecture
Here are 32 public repositories matching this topic...
Canari v3 - next gen Maltego framework for rapid remote and local transform development
python docker framework aws-lambda python3 tds maltego rapid-development lambda-architecture maltego-transformations canari
-
Updated
Apr 21, 2021 - Python
Secondo progetto per il corso di Big Data durante A.A. 2020/2021. Progetto che si incentra sulla creazione di una architettura lambda per effettuare analisi streaming e batch su dati estratti dalla piattaforma Twitch.
-
Updated
Sep 28, 2021 - Python
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
streaming kafka spark realtime zookeeper python3 pyspark mysql-database pub-sub batch-processing lambda-architecture kafka-topics no-api ubuntu2204
-
Updated
May 27, 2023 - Python
Create data pipeline using Lambda architecture with Spark, Kafka, Airflow and Snowflake
-
Updated
Jul 26, 2023 - Python
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
python java machine-learning streaming apache-spark spring-boot hbase pyspark hdfs ingestion apache-kafka postgresql-database powerbi batch-processing lambda-architecture apache-airflow big-data-projects
-
Updated
Apr 15, 2024 - Python
Electrical Consumption Monitoring - Big Data Pipeline using Lambda Architecture in Python
big-data cassandra docker-compose kafka-producer grafana-dashboard lambda-architecture spark-cassandra-connector trino big-data-processing big-data-pipeline
-
Updated
Jan 26, 2025 - Python
A data and analytics engineering platform designed for real-time sports betting analytics.
aws airflow kafka grafana snowflake data-engineering spark-streaming druid dbt cdc lambda-architecture sports-betting analytics-engineering olap-database betflow
-
Updated
Mar 21, 2025 - Python
This project implements an end-to-end techstack for a data platform, for local development.
-
Updated
Sep 22, 2025 - Python
Architecture Big Data temps réel (Lambda, HDFS-first) pour l'analyse de signaux planétaires — Kafka, Hadoop, Spark, MongoDB
python docker streaming kafka big-data apache-spark mongodb hadoop data-engineering hdfs lambda-architecture anomaly-detection
-
Updated
Dec 11, 2025 - Python
Lambda Architecture for real-time traffic speed (TomTom) and air quality (OpenAQ) data in Ho Chi Minh City. Streams to Kafka/JSON, processes with PySpark, persists in Lakehouse (MinIO + Delta Lake), and highlights critical periods where PM2.5 spikes align with congestion, supporting smart city traffic and health decisions.
python kafka big-data pyspark minio pm25 openaq data-pipeline vietnam lambda-architecture smart-city hcmc delta-lake lakehouse tomtom-api air-quality-monitoring
-
Updated
Dec 25, 2025 - Python
Python-based streaming analytics platform combining real-time metrics with batch historical analysis. Uses a Kafka-compatible event stream, Redis speed layer, and AWS S3 + Athena pipeline — a practical implementation of the Lambda Architecture.
-
Updated
Jan 2, 2026 - Python
Big Data project integrating Polymarket prediction data and Binance cryptocurrency rates to analyse relationships between market expectations and real prices.
data-science big-data apache-spark hadoop cryptocurrency apache-kafka apache-nifi lambda-architecture apache-hive binance apache-hbase polymarket
-
Updated
Jan 19, 2026 - Python
Modern büyük veri araçlarıyla (Spark, Flink, Kafka) Twitter duygu analizi mimarisi. Veri işleme, anlık alarm mekanizması ve çoklu veri saklama (Parquet/Avro) formatlarını içeren full-stack data engineering projesi.
avro spark-streaming parquet kafka-producer lambda-architecture flink-stream-processing big-data-analytics
-
Updated
Feb 13, 2026 - Python
GCP Lambda architecture with Batch (Parquet ETL) and Streaming (Pub/Sub → Dataflow → BigQuery).
bigquery streaming gcp google-cloud pubsub data-engineering dataflow apache-beam batch-processing lambda-architecture
-
Updated
Feb 24, 2026 - Python
Spark-Streaming-Crypto is a high-performance Big Data pipeline designed for the real-time ingestion, processing, and analysis of cryptocurrency market data and its correlation with media events. Leveraging a Lambda Architecture, this project demonstrates how to handle high-velocity data streams to provide actionable insights into market volatility.
docker streaming crypto kafka big-data apache-spark cryptocurrency pyspark data-engineering real-time-analytics lambda-architecture delta-lake
-
Updated
Mar 2, 2026 - Python
Data Pipeline for Electronic Health Records
data-science streaming-data lambda-architecture mlops-workflow medallion-architecture eletronic-health-record
-
Updated
Jun 7, 2026 - Python
Add this topic to your repo
To associate your repository with the lambda-architecture topic, visit your repo's landing page and select "manage topics."