data-modeling

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

MetricFlow allows you to define, build, and maintain metrics in code.

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.

Linked Open Data Modeling Language

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Link Modeling Language (LinkML) model

Define, govern, and model event data for warehouse-first product analytics.

Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables

Agentic & No-Code Data Transformations

Automated assistance for the schema development lifecycle

This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source tools

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

The dbt adapter for Firebolt

WG3 Metadata Specification

Development of the Gellish Communicator reference application and tools for universal data exchange and data integration supporting Formal English and other Gellish formalized natural languages.

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.