azure-data-engineering

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Database.

End-to-end Azure Databricks retail data engineering project using Medallion Architecture (Bronze, Silver, Gold). Implements Auto Loader, Unity Catalog, Delta Lake, SCD Type 1 & 2 dimensions, and Fact Orders for analytics-ready star schema modeling.

End-to-end Azure Data Engineering pipeline using ADF, Databricks (PySpark), ADLS Gen2, Azure SQL, and Power BI for COVID-19 analytics

Practical Microsoft learning blueprints for Fabric, Power BI, Azure Data, AI, governance, CI/CD, and real-world analytics engineering projects.

End-to-end Azure Data Engineering project using ADF for incremental ingestion, Databricks (DLT) for Medallion Architecture, and Delta Lake for CDC (SCD Type 1). Managed via Databricks Asset Bundles (DABs) for professional CI/CD. Focuses on real-time streaming, scalability, and Star Schema modeling.

Designed and implemented an end-to-end Azure Data Engineering platform using Azure Data Factory, ADLS Gen2, Databricks, Synapse Analytics, and Power BI. Built metadata-driven pipelines and Medallion Architecture (Bronze, Silver, Gold) to ingest, transform, and serve analytics-ready data.

Designed a production-grade Azure Data Engineering project centered on Azure Data Factory. Built dynamic, metadata-driven pipelines to ingest data from on-prem systems, REST APIs, and Azure SQL into ADLS Gen2 using Medallion Architecture, incremental loading, and enterprise-scale orchestration patterns.

Metadata-driven Azure Data Factory ETL Framework using Azure SQL, SQL Server,ADLS Gen2 and SHIR

End-to-end Azure Data Engineering project using ADF, Databricks, ADLS, Synapse, and Power BI

Production-style Azure Data Factory platform featuring incremental ingestion, SCD Type 2, Azure SQL, Key Vault, monitoring, Bicep IaC, and Azure DevOps CI/CD.

End-to-end Order-to-Cash analytics pipeline using Azure, Python ETL, SQL warehouse and Power BI dashboard

GitOps-driven Azure Data Factory pipeline that ingests multi-source data (GitHub + ADLS) into ADLS Bronze using dynamic, parameterized ETL workflows.

End-to-end Azure data engineering portfolio featuring ADF, Databricks, PySpark, ADLS Gen2, Delta Lake, Synapse and SQL

End-to-end real-time data pipeline using Kafka, Spark, Delta Lake, DuckDB, and Power BI. Simulates clickstream analytics with batch + streaming workflows for modern data engineering.

Power BI dashboard analyzing client credit default patterns

Azure Data Engineering project for insurance claims data processing using Azure Data Factory, ADLS Gen2, Databricks, PySpark and Delta Lake.

This project implements an end-to-end Azure Data Engineering pipeline using Spotify streaming data, with a primary focus on duplicate data handling and data quality optimization

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Database.

Event-driven data pipeline built in Databricks — ingests multi-domain data (customers, orders, inventory, products, shipping), applies validation, enrichment, and performs final merge operations using Delta Lake.

Production-grade parameterized ETL pipeline implementing SCD Type 2 for travel booking data using Databricks, Delta Lake, and ADLS — includes data quality checks, incremental fact table build, Z-Order optimization, and SQL reporting.