Data Engineering

Data pipelines, warehousing, big data and distributed systems.

Data Foundations & SQL

• Introduction to Data Engineering & the Data Lifecycle
• Sets, Relations & Functions
• SQL for Data Engineering: Joins, Aggregations & Window Functions

Data Modelling

• Data Modelling: Normalisation, Star Schemas & SCDs

Pipelines & Orchestration

• Graph Theory & Networks
• Data Pipelines: ETL/ELT, Orchestration & Idempotency

Storage & Distributed Compute

• Storage: Warehouses, Lakes, Lakehouses & File Formats
• Distributed Processing: MapReduce, Spark & Big Data

Real-Time Streaming

• Stream Processing: Kafka, Windows & Exactly-Once

Quality, Governance & DataOps

• Descriptive Statistics
• Data Quality, Observability & Governance
• MLOps, Deployment & Responsible AI