Course10810100676 lectures
Optimal Control Systems
Prof. Dwaipayan Mukherjee · IIT Bombay
About
This is a graduate level course on optimal that will trace the journey of the subject, as it has evolved over more than two millennia. The course, while presenting the different settings under which optimal control problems are usually studied, such as fixed and variable end-points, fixed and variable terminal time, etc., will also connect these paradigms under an overarching theme of dynamic optimization, so that these different settings do not seem like specific cases that need to be memorized. The focus will be more on developing a deep conceptual understanding of the subject matter, as opposed to numerical methods for solving problems in optimal control. The centerpiece of the course would be a complete but accessible proof of Pontryagin’s Maximum Principle (PMP) which would enable the student to see how ideas from calculus of variations fit in perfectly when viewed through the lens of PMP. The course should be particularly useful to graduate students (masters and PhD students) who endeavor to solve theoretical problems in control theory, machine intelligence, data science, robust and optimal control, and related areas.
Intended audience: PGs and PhD from Electrical, Mechanical, Civil, Chem engg. Also MATHS majors and economics majors can attend
Prerequisites: Basic background in college level calculus (usually taught in first year) is necessary. Some background in optimization is helpful, though not necessary.
Lectures
Week 1
- Lecture 1: Introduction: Optimal control-Part A
- Lecture 2: Introduction: Optimal control-Part B
- Lecture 3: First order condition for minima
- Lecture 4: Second order condition for minima
- Lecture 5: Minima over closed sets
- Lecture 6: Constrained minimization
- Lecture 7: Reflection and refraction
Week 2
- Lecture 8: Brachistochrone problem
- Lecture 9: Strong and weak extrema
- Lecture 10: Existence of extrema
- Lecture 11: First variation of functionals
- Lecture 12: Euler Langrage condition
- Lecture 13: Special cases of Euler Lagrange equation
- Lecture 14: Brachistochrone revisited
Week 3
- Lecture 15: Reymond Dubois lemma
- Lecture 16: Transversality condition
- Lecture 17: The Hamiltonian formalism
- Lecture 18: Principle of least action
- Lecture 19: Lagrange multipliers in calculus of variations
- Lecture 20: Dido's problem and catenary: Revisited
Week 4
- Lecture 21: Holonomic constraints
- Lecture 22: Second order condition for optimality
- Lecture 23: Hamiltonian maximization: An intuition
- Lecture 24: Conjugate points: Jacobi's equation
- Lecture 25: An application of Rolle's theorem
- Lecture 26: Sufficient second order condition
Week 5
- Lecture 27: Broken extremals
- Lecture 28: Weierstrass Erdmann corner conditions
- Lecture 29: Removable discontinuities: Interpretation of W- E conditions
- Lecture 30: Weierstrass excess function
- Lecture 31: Excess function: A step towards maximum principle
- Lecture 32: From calculus of variations to optimal control
- Lecture 33: Setting up the optimal control problem: Mayer and Lagrange forms
Week 6
- Lecture 34: Towards maximum principle: Calculus of variations based approach
- Lecture 35: Limitations of calculus of variations
- Lecture 36: Brachistochrone as an optimal control problem
- Lecture 37: Maximum principle: Statement
- Lecture 38: Maximum principle: Variable end point
- Lecture 39: Temporal perturbations
- Lecture 40: Spatial (Needle) perturbations
Week 7
- Lecture 41: Variational equation
- Lecture 42: Concatenation of needle perturbations
- Lecture 43: Topological concepts
- Lecture 44: An application of Brouwers fixed point theorem
- Lecture 45: Separating hyperplane and costates
- Lecture 46: Maximization of the Hamiltonian
- Lecture 47: Properties of the Hamiltonian
Week 8
- Lecture 48: Transversality condition under PMP
- Lecture 49: PMP applied to different settings-Part A
- Lecture 50: PMP applied to different settings-Part B
- Lecture 51: Time optimal control: Double integrators
- Lecture 52: Time optimal control: LTI Systems-Part A
- Lecture 53: Time optimal control: LTI Systems-Part B
- Lecture 54: Existence of time optimal control
Week 9
- Lecture 55: Discussions on PMP
- Lecture 56: Introduction to dynamic programming
- Lecture 57: Value function: Definition
- Lecture 58: Hamilton Jacobi Bellman (HJB) equation
- Lecture 59: Solving the HJB equation: An Example
- Lecture 60: Sufficiency associated with the HJB equation
Week 10
- Lecture 61: Limitations of HJB based approach
- Lecture 62: LQR formulation: Solution through completion of square
- Lecture 63: Properties of the solution to Riccati differential equation (RDE)
- Lecture 64: Towards solving the LQR problem : A PMP Based approach
- Lecture 65: LQR solution : Combining PMP and the HJB equation
- Lecture 66: Solution of RDE: Solving a linear system of equations
Week 11
- Lecture 67: Infinite horizon LQR : Algebraic Riccati equation (ARE)
- Lecture 68: Infinite horizon LQR : Optimality of candidate identified from ARE
- Lecture 69: Stability of closed loop system in infinite horizon LQR
- Lecture 70: Summary of results related to infinite horizon LQR
- Lecture 71: Infinite horizon LQR : A scalar example
Week 12
Syllabus and materials
At NPTEL, as the course publishes them.
Credits and licence
- Institution
- IIT Bombay
- Department
- Electrical Engineering
- Teacher
- Prof. Dwaipayan Mukherjee
- Level
- Graduate
- Language
- English
- Subjects
- Engineering
- Source
- NPTEL
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
- Who can watch
- NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed