Learn · NPTEL

Course10810100676 lectures

Optimal Control Systems

Prof. Dwaipayan Mukherjee · IIT Bombay

Start with lecture 1 At NPTEL

About

This is a graduate level course on optimal that will trace the journey of the subject, as it has evolved over more than two millennia. The course, while presenting the different settings under which optimal control problems are usually studied, such as fixed and variable end-points, fixed and variable terminal time, etc., will also connect these paradigms under an overarching theme of dynamic optimization, so that these different settings do not seem like specific cases that need to be memorized. The focus will be more on developing a deep conceptual understanding of the subject matter, as opposed to numerical methods for solving problems in optimal control. The centerpiece of the course would be a complete but accessible proof of Pontryagin’s Maximum Principle (PMP) which would enable the student to see how ideas from calculus of variations fit in perfectly when viewed through the lens of PMP. The course should be particularly useful to graduate students (masters and PhD students) who endeavor to solve theoretical problems in control theory, machine intelligence, data science, robust and optimal control, and related areas.

Intended audience: PGs and PhD from Electrical, Mechanical, Civil, Chem engg. Also MATHS majors and economics majors can attend

Prerequisites: Basic background in college level calculus (usually taught in first year) is necessary. Some background in optimization is helpful, though not necessary.

Lectures

Week 1

  1. Lecture 1: Introduction: Optimal control-Part A YouTube
  2. Lecture 2: Introduction: Optimal control-Part B YouTube
  3. Lecture 3: First order condition for minima YouTube
  4. Lecture 4: Second order condition for minima YouTube
  5. Lecture 5: Minima over closed sets YouTube
  6. Lecture 6: Constrained minimization YouTube
  7. Lecture 7: Reflection and refraction YouTube

Week 2

  1. Lecture 8: Brachistochrone problem YouTube
  2. Lecture 9: Strong and weak extrema YouTube
  3. Lecture 10: Existence of extrema YouTube
  4. Lecture 11: First variation of functionals YouTube
  5. Lecture 12: Euler Langrage condition YouTube
  6. Lecture 13: Special cases of Euler Lagrange equation YouTube
  7. Lecture 14: Brachistochrone revisited YouTube

Week 3

  1. Lecture 15: Reymond Dubois lemma YouTube
  2. Lecture 16: Transversality condition YouTube
  3. Lecture 17: The Hamiltonian formalism YouTube
  4. Lecture 18: Principle of least action YouTube
  5. Lecture 19: Lagrange multipliers in calculus of variations YouTube
  6. Lecture 20: Dido's problem and catenary: Revisited YouTube

Week 4

  1. Lecture 21: Holonomic constraints YouTube
  2. Lecture 22: Second order condition for optimality YouTube
  3. Lecture 23: Hamiltonian maximization: An intuition YouTube
  4. Lecture 24: Conjugate points: Jacobi's equation YouTube
  5. Lecture 25: An application of Rolle's theorem YouTube
  6. Lecture 26: Sufficient second order condition YouTube

Week 5

  1. Lecture 27: Broken extremals YouTube
  2. Lecture 28: Weierstrass Erdmann corner conditions YouTube
  3. Lecture 29: Removable discontinuities: Interpretation of W- E conditions YouTube
  4. Lecture 30: Weierstrass excess function YouTube
  5. Lecture 31: Excess function: A step towards maximum principle YouTube
  6. Lecture 32: From calculus of variations to optimal control YouTube
  7. Lecture 33: Setting up the optimal control problem: Mayer and Lagrange forms YouTube

Week 6

  1. Lecture 34: Towards maximum principle: Calculus of variations based approach YouTube
  2. Lecture 35: Limitations of calculus of variations YouTube
  3. Lecture 36: Brachistochrone as an optimal control problem YouTube
  4. Lecture 37: Maximum principle: Statement YouTube
  5. Lecture 38: Maximum principle: Variable end point YouTube
  6. Lecture 39: Temporal perturbations YouTube
  7. Lecture 40: Spatial (Needle) perturbations YouTube

Week 7

  1. Lecture 41: Variational equation YouTube
  2. Lecture 42: Concatenation of needle perturbations YouTube
  3. Lecture 43: Topological concepts YouTube
  4. Lecture 44: An application of Brouwers fixed point theorem YouTube
  5. Lecture 45: Separating hyperplane and costates YouTube
  6. Lecture 46: Maximization of the Hamiltonian YouTube
  7. Lecture 47: Properties of the Hamiltonian YouTube

Week 8

  1. Lecture 48: Transversality condition under PMP YouTube
  2. Lecture 49: PMP applied to different settings-Part A YouTube
  3. Lecture 50: PMP applied to different settings-Part B YouTube
  4. Lecture 51: Time optimal control: Double integrators YouTube
  5. Lecture 52: Time optimal control: LTI Systems-Part A YouTube
  6. Lecture 53: Time optimal control: LTI Systems-Part B YouTube
  7. Lecture 54: Existence of time optimal control YouTube

Week 9

  1. Lecture 55: Discussions on PMP YouTube
  2. Lecture 56: Introduction to dynamic programming YouTube
  3. Lecture 57: Value function: Definition YouTube
  4. Lecture 58: Hamilton Jacobi Bellman (HJB) equation YouTube
  5. Lecture 59: Solving the HJB equation: An Example YouTube
  6. Lecture 60: Sufficiency associated with the HJB equation YouTube

Week 10

  1. Lecture 61: Limitations of HJB based approach YouTube
  2. Lecture 62: LQR formulation: Solution through completion of square YouTube
  3. Lecture 63: Properties of the solution to Riccati differential equation (RDE) YouTube
  4. Lecture 64: Towards solving the LQR problem : A PMP Based approach YouTube
  5. Lecture 65: LQR solution : Combining PMP and the HJB equation YouTube
  6. Lecture 66: Solution of RDE: Solving a linear system of equations YouTube

Week 11

  1. Lecture 67: Infinite horizon LQR : Algebraic Riccati equation (ARE) YouTube
  2. Lecture 68: Infinite horizon LQR : Optimality of candidate identified from ARE YouTube
  3. Lecture 69: Stability of closed loop system in infinite horizon LQR YouTube
  4. Lecture 70: Summary of results related to infinite horizon LQR YouTube
  5. Lecture 71: Infinite horizon LQR : A scalar example YouTube

Week 12

  1. Lecture 72: Optimal interception problem: Part 1 YouTube
  2. Lecture 73: Optimal interception problem: Part 2 YouTube
  3. Lecture 74: H_2 optimal control: Motivation YouTube
  4. Lecture 75: H_2 optimal control: Well posedness YouTube
  5. Lecture 76: H_2 optimal control and LQR YouTube

Syllabus and materials

At NPTEL, as the course publishes them.

Credits and licence

Institution
IIT Bombay
Department
Electrical Engineering
Teacher
Prof. Dwaipayan Mukherjee
Level
Graduate
Language
English
Subjects
Engineering
Source
NPTEL
Licence
CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
Attribution
NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
Who can watch
NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed