GPU & Parallel Programming
The planned outline of 11 modules. Lessons are written, run and reviewed before they are published.
Before this track
Planned outline
- Module 1
Start here: parallel hardware and data-parallel thinking
Coming soon - Module 2
SIMD on the CPU: vectorisation you can verify
Coming soon - Module 4
How GPUs run code: the model behind every GPU API
Coming soon - Module 5
WebGPU compute in the browser
Coming soon - Module 6
CUDA concepts and programming (recorded on NVIDIA GPUs)
Coming soon - Module 7
Parallel patterns: map, reduce, scan, sort, sparse, GEMM
Coming soon - Module 8
Distributed memory with MPI
Coming soon - Module 9
Multi-GPU and AI-infrastructure kernels
Coming soon - Module 10
Beyond CUDA: GPU APIs and performance portability
Coming soon - Module 11
Optimisation method, interviews and careers
Coming soon
Related tools
Blur, Pixelate & Redact Image Hide faces, plates, names and numbers — blur, pixelate or a solid box, on your device. Photo Filters & Adjustments One-click looks, .cube LUTs and precise adjustments — at full resolution, in your browser. Matrix Calculator Matrices up to 10 × 10 in exact fractions — every step, from determinants to the SVD. IEEE 754 Floating-Point Converter See exactly how a number is stored in binary floating point — every bit, every digit. Programmer Calculator (Bitwise) Bitwise maths at a real bit width — with overflow, endianness and every base at once.
Official documentation
- www.w3.org/TR/webgpu (w3.org)
- www.w3.org/TR/WGSL (w3.org)
- www.openmp.org/specifications (openmp.org)
- www.mpi-forum.org/docs (mpi-forum.org)
- docs.nvidia.com/cuda/cuda-programming-guide/index.html (docs.nvidia.com)
- docs.nvidia.com/cuda/cuda-c-best-practices-guide/index.html (docs.nvidia.com)
More in Computer science fundamentals
- Object-Oriented Programming (coming soon)
- Database Management Systems (coming soon)
- Operating Systems (coming soon)
- Computer Networks (coming soon)
- All CS fundamentals tracks
- How we make lessons