# Reinforcement Learning

- Institution: IIT Madras
- Department: Computer Science and Engineering
- Teacher: Prof. Balaraman Ravindran
- Level: Undergraduate
- Language: English
- Subjects: Computer science, Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/106106143)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/106106143)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Reinforcement learning is a paradigm that aims to model the trial-and-error learning process that is needed in many problem situations where explicit instructive signals are not available. It has roots in operations research, behavioral psychology and AI. The goal of the course is to introduce the basic mathematical foundations of reinforcement learning, as well as highlight some of the recent directions of research.

Intended audience: Any interested learner

## Lectures

1. [Introduction to RL](https://invisiblenetwork.ai/learn/nptel/106106143/0dbc3f872848) (YouTube)
2. [RL Framework and Applications](https://invisiblenetwork.ai/learn/nptel/106106143/efe48206a3a5) (YouTube)
3. [Introduction to Immediate RL](https://invisiblenetwork.ai/learn/nptel/106106143/c4bdc1fa4849) (YouTube)
4. [Bandit Optimalities](https://invisiblenetwork.ai/learn/nptel/106106143/6449410af8dc) (YouTube)
5. [Value Function Based Methods](https://invisiblenetwork.ai/learn/nptel/106106143/b002f48a66d2) (YouTube)
6. [UCB 1](https://invisiblenetwork.ai/learn/nptel/106106143/baea3059a282) (YouTube)
7. [Concentration Bounds](https://invisiblenetwork.ai/learn/nptel/106106143/3a5999c435c5) (YouTube)
8. [UCB 1 Theorem](https://invisiblenetwork.ai/learn/nptel/106106143/ac4a527fbc76) (YouTube)
9. [PAC Bounds](https://invisiblenetwork.ai/learn/nptel/106106143/460fe68265bd) (YouTube)
10. [Median Elimination](https://invisiblenetwork.ai/learn/nptel/106106143/cc4a6dd78159) (YouTube)
11. [Thompson Sampling](https://invisiblenetwork.ai/learn/nptel/106106143/19296cce987a) (YouTube)
12. [Policy Search](https://invisiblenetwork.ai/learn/nptel/106106143/86fd4274626a) (YouTube)
13. [REINFORCE](https://invisiblenetwork.ai/learn/nptel/106106143/7c59c3d4e777) (YouTube)
14. [Contextual Bandits](https://invisiblenetwork.ai/learn/nptel/106106143/4458634cd24d) (YouTube)
15. [Full RL Introduction](https://invisiblenetwork.ai/learn/nptel/106106143/be133aa8a18b) (YouTube)
16. [Returns, Value Functions and MDPs](https://invisiblenetwork.ai/learn/nptel/106106143/c6de308ebb49) (YouTube)
17. [MDP Modelling](https://invisiblenetwork.ai/learn/nptel/106106143/9d7c6408c2a2) (YouTube)
18. [Bellman Equation](https://invisiblenetwork.ai/learn/nptel/106106143/2575ec6538a5) (YouTube)
19. [Bellman Optimality Equation](https://invisiblenetwork.ai/learn/nptel/106106143/d712cefccf55) (YouTube)
20. [Cauchy Sequence and Green's Equation](https://invisiblenetwork.ai/learn/nptel/106106143/5c6856835a5c) (YouTube)
21. [Banach Fixed Point Theorem](https://invisiblenetwork.ai/learn/nptel/106106143/98aeed210d7e) (YouTube)
22. [Convergence Proof](https://invisiblenetwork.ai/learn/nptel/106106143/a1f0c5211e9a) (YouTube)
23. [Lpi Convergence](https://invisiblenetwork.ai/learn/nptel/106106143/e49228349b52) (YouTube)
24. [Value Iteration](https://invisiblenetwork.ai/learn/nptel/106106143/cf713c1d9ec7) (YouTube)
25. [Policy Iteration](https://invisiblenetwork.ai/learn/nptel/106106143/098eafef8d57) (YouTube)
26. [Dynamic Programming](https://invisiblenetwork.ai/learn/nptel/106106143/2f73c1603993) (YouTube)
27. [Monte Carlo](https://invisiblenetwork.ai/learn/nptel/106106143/9a6b9c072b05) (YouTube)
28. [Control in Monte Carlo](https://invisiblenetwork.ai/learn/nptel/106106143/014f0461ffc8) (YouTube)
29. [Off Policy MC](https://invisiblenetwork.ai/learn/nptel/106106143/9fd864ef9459) (YouTube)
30. [UCT](https://invisiblenetwork.ai/learn/nptel/106106143/6eba51fe791d) (YouTube)
31. [TD(0)](https://invisiblenetwork.ai/learn/nptel/106106143/ba39361950a7) (YouTube)
32. [TD(0) Control](https://invisiblenetwork.ai/learn/nptel/106106143/dbff27a598a5) (YouTube)
33. [Q-Learning](https://invisiblenetwork.ai/learn/nptel/106106143/1cc3e5a1e504) (YouTube)
34. [Afterstate](https://invisiblenetwork.ai/learn/nptel/106106143/1076942faf65) (YouTube)
35. [Eligibility Traces](https://invisiblenetwork.ai/learn/nptel/106106143/26951e22ffe5) (YouTube)
36. [Backward View of Eligibility Traces](https://invisiblenetwork.ai/learn/nptel/106106143/07738cf64053) (YouTube)
37. [Eligibility Trace Control](https://invisiblenetwork.ai/learn/nptel/106106143/847aead73525) (YouTube)
38. [Thompson Sampling Recap](https://invisiblenetwork.ai/learn/nptel/106106143/a5fbd9626e15) (YouTube)
39. [Function Approximation](https://invisiblenetwork.ai/learn/nptel/106106143/86194b31c511) (YouTube)
40. [Linear Parameterization](https://invisiblenetwork.ai/learn/nptel/106106143/d3ff8fbd8451) (YouTube)
41. [State Aggregation Methods](https://invisiblenetwork.ai/learn/nptel/106106143/3c26c39f22ee) (YouTube)
42. [Function Approximation and Eligibility Traces](https://invisiblenetwork.ai/learn/nptel/106106143/8022e98503cc) (YouTube)
43. [LSTD and LSTDQ](https://invisiblenetwork.ai/learn/nptel/106106143/edbe8e3581aa) (YouTube)
44. [LSPI and Fitted Q](https://invisiblenetwork.ai/learn/nptel/106106143/e060f9fb4631) (YouTube)
45. [DQN and Fitted Q-Iteration](https://invisiblenetwork.ai/learn/nptel/106106143/e5b515aa67b0) (YouTube)
46. [Policy Gradient Approach](https://invisiblenetwork.ai/learn/nptel/106106143/6254aa4f7a9d) (YouTube)
47. [Actor Critic and REINFORCE](https://invisiblenetwork.ai/learn/nptel/106106143/b1ef9a479236) (YouTube)
48. [REINFORCE (cont'd)](https://invisiblenetwork.ai/learn/nptel/106106143/6f3870cf7a35) (YouTube)
49. [Policy Gradient with Function Approximation](https://invisiblenetwork.ai/learn/nptel/106106143/936ee73448ac) (YouTube)
50. [Hierarchical Reinforcement Learning](https://invisiblenetwork.ai/learn/nptel/106106143/dfab0aee62e3) (YouTube)
51. [Types of Optimality](https://invisiblenetwork.ai/learn/nptel/106106143/a9d4fd02d4bf) (YouTube)
52. [Semi Markov Decision Processes](https://invisiblenetwork.ai/learn/nptel/106106143/8deb53c3965b) (YouTube)
53. [Options](https://invisiblenetwork.ai/learn/nptel/106106143/545bd808d518) (YouTube)
54. [Learning with Options](https://invisiblenetwork.ai/learn/nptel/106106143/7c38fa3874ab) (YouTube)
55. [Hierarchical Abstract Machines](https://invisiblenetwork.ai/learn/nptel/106106143/9530a447e255) (YouTube)
56. [MAXQ](https://invisiblenetwork.ai/learn/nptel/106106143/65cad2310a5d) (YouTube)
57. [MAXQ Value Function Decomposition](https://invisiblenetwork.ai/learn/nptel/106106143/e597ba3b8c42) (YouTube)
58. [Option Discovery](https://invisiblenetwork.ai/learn/nptel/106106143/051b47500b60) (YouTube)
59. [POMDP Introduction](https://invisiblenetwork.ai/learn/nptel/106106143/ada008fd1d90) (YouTube)
60. [Solving POMDP](https://invisiblenetwork.ai/learn/nptel/106106143/384ae6db56b3) (YouTube)