Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Aniket Abhishek Soni

Oct 27

How to Integrate SQL Databases with Fabric Lakehouses

#microsoftfabric #dataengineering #sql #architecture

4 min read

Keshav

Oct 26

Airflow vs Dagster vs Prefect: How to Choose

#dataengineering #airflow #python #devops

13 min read

sireesha

Oct 27

VynelixAI Agent Studio: Testing Real Data Workflows with MongoDB, Amazon S3, and ClickHouse

#ai #opensource #dataengineering #python

1 min read

Andrew Tan

Oct 27

Streamhouse Is the New Buzzword. Here's the Part That Actually Matters.

#streamhouse #dataengineering #realtimedata #dataarchitecture

9 min read

Cristhian Carlos MAMANI CORI

Oct 26

Building an Automated Weather Data Pipeline with Python, DuckDB, dbt, and GitHub Actions

#dataengineering

5 min read

Malavnaik

Oct 26

I Built a Tested Data Pipeline for Dublin Bikes, for €0

#dataengineering #dbt #duckdb #python

3 min read

Karan Pulyala

Oct 26

Repartition vs Coalesce vs partitionBy on Azure Databricks: Controlling Output Files When Writing Delta Tables

#databricks #pyspark #spark #dataengineering

6 min read

Rupak Kulkarni

Oct 26

From Google- and Meta-Like CSVs to a Trusted Schema: Building Fail-Closed Python Adapters

#python #dataengineering #etl #testing

6 min read

Gowtham Potureddi

Oct 26

Designing a movie ticket booking system: the low-level design interview, explained

#walkin #interview #designsystem #dataengineering

16 min read

Joud Awad

Oct 26

Data Lake vs Data Warehouse vs Data Lakehouse: Data Engineering Simplified

#dataengineering #systemdesign #database #abotwrotethis

2 min read

AI Data Legends

Oct 26

Databricks Lakehouse Platform for Real-Time, Agentic Data and AI Workloads

#aiagents #dataengineering #databricks #lakehouse

3 min read

AI Data Legends

Oct 26

n8n Bridges Workflow Automation and API Management, With Important Trade-offs

#aiagents #apimanagement #dataengineering #n8n

3 min read

AI Data Legends

Oct 26

Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale

#dataengineering #databricks #lakehouse #sql

4 min read

Mohammed Arshad Ansari

Oct 26

Querying Parquet on S3 with DuckDB: secrets, speed and the settings that matter

#dataengineering #database #sql #tutorial

3 min read

Gowtham Potureddi

Oct 26

SOLID principles explained: the foundation of an object-oriented design interview

#designsystem #walkin #interview #dataengineering

13 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.