Course

Fundamentals of Robotics

Control fundamentals, MPC, and deep RL for robotics.

An in-development robotics course built around one practical contrast: classical control versus learned control.

The planned syllabus moves from mechanics and control fundamentals into model-predictive control, deep reinforcement learning, and side-by-side comparisons on environments such as inverted pendulums, Reacher, and Hopper.

The aim is to build a clean bridge from traditional engineering intuition to modern robotics control methods, rather than treating them as separate disciplines.

What the course covers

The current robotics syllabus in Notion is structured as a progression from control and mechanics fundamentals into model-predictive control, deep reinforcement learning, and side-by-side comparisons on standard benchmark environments.

Introduction and framing

Establish the course framing and the central contrast between classical and learned control.

  • Welcome & Motivation: Classical vs Learned Control
  • Introduction // tour of the repo
  • Introduction to solid mechanics
  • Introduction to control engineering
  • Intro to classical control (theory, intuition, why important)
  • Recap: inverted pendulum

Mechanics and modelling

Build the modelling tools used later in both MPC and learned-control sections.

  • Lagrangian methods (energy) - IP
  • Lagrangian methods (energy) - DIP
  • Newton - Euler methods (force) - IP
  • Discretisation: Euler
  • Discretisation: RK4
  • Cost functions
  • Initial guesses

Model predictive control

Introduce MPC as a strong classical baseline, then work through concrete robotics examples.

  • Intro to MPC
  • Intro to CasADI
  • Hands on: IP // MPC controller
  • Hands on: MPC // Reacher

Deep reinforcement learning for control

Move from classical controllers into policy-learning methods for harder control settings.

  • Why DRL
  • Intro to DRL for control
  • Intro to StableBaselines // PPO
  • DQN
  • Introduction to MuJoCo environments
  • Hands on: inverted pendulum swing up
  • Hands on: DRL // Reacher
  • Hands on: DRL // Hopper
  • Hands on: double inverted pendulum (DIP)

Comparative case studies

Compare classical and learned methods on matched environments rather than treating them as separate worlds.

  • DIP comparison: MPC vs DRL
  • Full comparison: MPC vs DRL

Close

  • Conclusion & congratulations