Data Engineering
The planned outline of 16 modules. Lessons are written, run and reviewed before they are published.
Before this track
Planned outline
- Module 1
Foundations: what data engineers build
Coming soon - Module 2
Data types, files and formats
Coming soon - Module 3
Ingestion: getting data in
Coming soon - Module 4
Storage: warehouses, lakes and lakehouses
Coming soon - Module 5
Data modelling for analytics
Coming soon - Module 6
SQL transformations that run every day
Coming soon - Module 7
Analytics engineering with dbt
Coming soon - Module 8
Orchestration: running pipelines on time
Coming soon - Module 9
Batch processing with Apache Spark
Coming soon - Module 10
Streaming foundations and Apache Kafka
Coming soon - Module 11
Stream processing engines
Coming soon - Module 12
Open table formats and the lakehouse
Coming soon - Module 13
Data quality, testing and observability
Coming soon - Module 14
Governance, security and privacy
Coming soon - Module 15
DataOps, cost and serving data
Coming soon - Module 16
Data platform design and interviews
Coming soon
Official documentation
- duckdb.org/docs (duckdb.org)
- spark.apache.org/docs/latest (spark.apache.org)
- docs.getdbt.com/docs/introduction (docs.getdbt.com)
- airflow.apache.org/docs (airflow.apache.org)
More in Data and databases
- Data Analysis with Python (pandas, polars, DuckDB) (coming soon)
- Probability & Statistics (coming soon)
- Excel & Google Sheets (coming soon)
- PostgreSQL in Depth (coming soon)
- All Data tracks
- How we make lessons