DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
AWS Glue Job Bookmarks Explained: Build Incremental ETL Pipelines with PySpark

AWS Glue Job Bookmarks Explained: Build Incremental ETL Pipelines with PySpark

1
Comments 1
7 min read
Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison

Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison

Comments
6 min read
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução

Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução

Comments
14 min read
## Load balancing for system design interviews, explained

## Load balancing for system design interviews, explained

Comments
14 min read
Designing a parking lot: the low-level design interview, explained

Designing a parking lot: the low-level design interview, explained

Comments
15 min read
Your salary coverage can fall before employers change

Your salary coverage can fall before employers change

Comments
7 min read
Message queues and pub/sub for system design interviews, explained

Message queues and pub/sub for system design interviews, explained

Comments
15 min read
Microservices architecture interview questions, answered

Microservices architecture interview questions, answered

Comments
16 min read
Building a Data Fabric on AWS: Connect Data, Improve Governance, and Power AI

Building a Data Fabric on AWS: Connect Data, Improve Governance, and Power AI

Comments
5 min read
Turn a Lighthouse export into tickets with traceable threshold evidence

Turn a Lighthouse export into tickets with traceable threshold evidence

Comments
3 min read
Operationalizing Data Contracts Between Producers and Consumers

Operationalizing Data Contracts Between Producers and Consumers

Comments
8 min read
Databricks Data Engineer Associate Exam 2026: Format, Domains and Study Plan

Databricks Data Engineer Associate Exam 2026: Format, Domains and Study Plan

Comments
3 min read
Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada

Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada

Comments
13 min read
Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks

Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks

Comments
10 min read
Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance

Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance

Comments
13 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.