Reinforcement Learning (Gymnasium and PyTorch)
The planned outline of 16 modules. Lessons are written, run and reviewed before they are published.
Before this track
Planned outline
- Module 1
Start here: the RL problem and your toolkit
Coming soon - Module 2
From bandits to Markov decision processes
Coming soon - Module 3
Planning with a known model: dynamic programming
Coming soon - Module 4
Learning from complete episodes: Monte Carlo
Coming soon - Module 5
Temporal-difference learning
Coming soon - Module 6
Function approximation
Coming soon - Module 7
Deep Q-networks
Coming soon - Module 8
Policy gradient methods
Coming soon - Module 9
Trust regions and PPO
Coming soon - Module 10
Off-policy actor-critic for continuous control
Coming soon - Module 11
Practical RL: environments, tools and evaluation
Coming soon - Module 12
Exploration, imitation and world models
Coming soon - Module 13
Offline RL and off-policy evaluation
Coming soon - Module 14
Games, search and multi-agent RL
Coming soon - Module 15
RL for language models: RLHF, RLVR and GRPO
Coming soon - Module 16
RL in the real world
Coming soon
Related tools
Probability Calculator Exact answers with the working — from coin tosses and dice to Bayes’ theorem. Matrix Calculator Matrices up to 10 × 10 in exact fractions — every step, from determinants to the SVD. Descriptive Statistics Calculator Every summary statistic of your data, with a box plot, histogram and stem-and-leaf. Line Graph Maker Line and area charts on a real date axis, with notes and moving averages. LLM Token Counter Exact token counts for OpenAI and open models — your text never leaves the browser.
Official documentation
- gymnasium.farama.org (gymnasium.farama.org)
- docs.pytorch.org/docs/stable/index.html (docs.pytorch.org)
- stable-baselines3.readthedocs.io/en/master (stable-baselines3.readthedocs.io)
- huggingface.co/docs/trl/index (huggingface.co)
More in AI and machine learning
- Machine Learning (scikit-learn) (coming soon)
- AI Literacy & Prompting (coming soon)
- Building LLM Applications (coming soon)
- Artificial Intelligence (classical AI and soft computing) (coming soon)
- All AI & ML tracks
- How we make lessons