# Essential Mathematics for Machine Learning

- Institution: IIT Roorkee
- Department: Mathematics
- Taught by: Prof. S. K. Gupta, Prof. Sanjeev Kumar
- Level: Undergraduate
- Language: English
- Subjects: Mathematics
- Source: [NPTEL](https://nptel.ac.in/courses/111107137)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/111107137)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Machine learning (ML) is one of the most popular topics of nowadays research. This particular topic is having applications in all the areas of engineering and sciences. Various tools of machine learning are having a rich mathematical theory. Therefore, in order to develop new algorithms of machine/deep learning, it is necessary to have knowledge of all such mathematical concepts. In this course, we will introduce these basic mathematical concepts related to the machine/deep learning. In particular, we will focus on topics from matrix algebra, calculus, optimization, and probability theory those are having strong linkage with machine learning. Applications of these topics will be introduced in ML with help of some real-life examples.

INTENDED AUDIENCE : UNDERGRADUATE AND POSTGRAUATE STUDENTS OF COMPUTER SCIENCE/MATHEMATICS/DATA SCIENCE…

## Lectures

1. [Vectors in Machine Learning](https://invisiblenetwork.ai/learn/nptel/111107137/6f03b9d1df70) (YouTube)
2. [Basics of Matrix Algebra](https://invisiblenetwork.ai/learn/nptel/111107137/16d4fc5faa1d) (YouTube)
3. [Vector Space: Definition and Examples](https://invisiblenetwork.ai/learn/nptel/111107137/d86cfd360f34) (YouTube)
4. [Vector Subspace: Examples and Properties](https://invisiblenetwork.ai/learn/nptel/111107137/6b372e038c38) (YouTube)
5. [Basis and Dimension](https://invisiblenetwork.ai/learn/nptel/111107137/9fced35fd45c) (YouTube)
6. [Linear Transformation](https://invisiblenetwork.ai/learn/nptel/111107137/b771fca32475) (YouTube)
7. [Norms and Spaces](https://invisiblenetwork.ai/learn/nptel/111107137/4866a7019fd0) (YouTube)
8. [Orthogonal Complement and Projection Mapping](https://invisiblenetwork.ai/learn/nptel/111107137/1cecdd8549d7) (YouTube)
9. [Eigenvalues and Eigenvectors](https://invisiblenetwork.ai/learn/nptel/111107137/473b7890c104) (YouTube)
10. [Special matrices and Properties](https://invisiblenetwork.ai/learn/nptel/111107137/16955164b645) (YouTube)
11. [Spectral Decomposition](https://invisiblenetwork.ai/learn/nptel/111107137/febeaad72e55) (YouTube)
12. [Singular Value Decomposition](https://invisiblenetwork.ai/learn/nptel/111107137/4d77ce5a8fe9) (YouTube)
13. [SVD: Properties and Applications](https://invisiblenetwork.ai/learn/nptel/111107137/fd89ec8a0220) (YouTube)
14. [Low Rank Approximations](https://invisiblenetwork.ai/learn/nptel/111107137/c4bc0d883e9c) (YouTube)
15. [Python Implementation of SVD and Low-rank Approximation](https://invisiblenetwork.ai/learn/nptel/111107137/c661a3f0e1bd) (YouTube)
16. [Principal Component Analysis-I](https://invisiblenetwork.ai/learn/nptel/111107137/950edafdcfa4) (YouTube)
17. [PCA : Derivation and Examples](https://invisiblenetwork.ai/learn/nptel/111107137/e3a94a9e2de3) (YouTube)
18. [Python Implementation of PCA](https://invisiblenetwork.ai/learn/nptel/111107137/270959c76999) (YouTube)
19. [Linear Discriminant Analysis](https://invisiblenetwork.ai/learn/nptel/111107137/8316b7574497) (YouTube)
20. [Python Implementation of LDA](https://invisiblenetwork.ai/learn/nptel/111107137/82f145ffa82c) (YouTube)
21. [Least Square Approximation and Minimum Normed Solution](https://invisiblenetwork.ai/learn/nptel/111107137/2196081bfe97) (YouTube)
22. [Linear and Multiple Regression-I](https://invisiblenetwork.ai/learn/nptel/111107137/3cb9dea8ca58) (YouTube)
23. [Linear and Multiple Regression-II](https://invisiblenetwork.ai/learn/nptel/111107137/9fdb1e95cb53) (YouTube)
24. [Logistic Regression-I](https://invisiblenetwork.ai/learn/nptel/111107137/a577b4a7df11) (YouTube)
25. [Logistic Regression-II](https://invisiblenetwork.ai/learn/nptel/111107137/55a05372d509) (YouTube)
26. [Classification Metrics](https://invisiblenetwork.ai/learn/nptel/111107137/3f4e0cabe064) (YouTube)
27. [Gram Schmidt process](https://invisiblenetwork.ai/learn/nptel/111107137/9e915fb21a48) (YouTube)
28. [Polar Decomposition](https://invisiblenetwork.ai/learn/nptel/111107137/09fe33be8451) (YouTube)
29. [Minimal Polynomial and Jordan Canonical Form-I](https://invisiblenetwork.ai/learn/nptel/111107137/79812a23e31d) (YouTube)
30. [Minimal Polynomial and Jordan Canonical Form-II](https://invisiblenetwork.ai/learn/nptel/111107137/d1d84dfc5344) (YouTube)
31. [Basic Concepts of Calculus-I](https://invisiblenetwork.ai/learn/nptel/111107137/d8374cd713d6) (YouTube)
32. [Basic Concepts of Calculus-II](https://invisiblenetwork.ai/learn/nptel/111107137/75f551355962) (YouTube)
33. [Basic Concepts of Calculus-III](https://invisiblenetwork.ai/learn/nptel/111107137/6a1755de3655) (YouTube)
34. [Basic Concepts of Calculus-IV](https://invisiblenetwork.ai/learn/nptel/111107137/10a1357d498f) (YouTube)
35. [Basic Concepts of Calculus-V](https://invisiblenetwork.ai/learn/nptel/111107137/d0763f48381c) (YouTube)
36. [Calculus in Python](https://invisiblenetwork.ai/learn/nptel/111107137/745ac14d5e97) (YouTube)
37. [Convex Sets and Functions](https://invisiblenetwork.ai/learn/nptel/111107137/d5c50a2cf771) (YouTube)
38. [Properties of Convex functions-I](https://invisiblenetwork.ai/learn/nptel/111107137/300e0af19f26) (YouTube)
39. [Properties of convex functions-II](https://invisiblenetwork.ai/learn/nptel/111107137/c96122ce3282) (YouTube)
40. [Introduction to Optimization](https://invisiblenetwork.ai/learn/nptel/111107137/0fbe11a5c61c) (YouTube)
41. [Unconstrained Optimization](https://invisiblenetwork.ai/learn/nptel/111107137/abeea68a2223) (YouTube)
42. [Constrained optimization-I](https://invisiblenetwork.ai/learn/nptel/111107137/36bd531b2121) (YouTube)
43. [Constrained optimization-II](https://invisiblenetwork.ai/learn/nptel/111107137/3a6b912d36d3) (YouTube)
44. [Steepest Descent Method](https://invisiblenetwork.ai/learn/nptel/111107137/a093d0ebc2f8) (YouTube)
45. [Newton’s and Penalty function method](https://invisiblenetwork.ai/learn/nptel/111107137/2a31ccf90305) (YouTube)
46. [Optimization using Python](https://invisiblenetwork.ai/learn/nptel/111107137/5744f45dbb56) (YouTube)
47. [Operations on Sets](https://invisiblenetwork.ai/learn/nptel/111107137/cc10e7fa3556) (YouTube)
48. [Review of Probability](https://invisiblenetwork.ai/learn/nptel/111107137/723edb82a3fb) (YouTube)
49. [Bayes theorem and random variable](https://invisiblenetwork.ai/learn/nptel/111107137/37333641dde7) (YouTube)
50. [Expectation and variance](https://invisiblenetwork.ai/learn/nptel/111107137/0be735bb148a) (YouTube)
51. [Discrete probability distributions](https://invisiblenetwork.ai/learn/nptel/111107137/2e537fe13705) (YouTube)
52. [Continuous Probability distributions](https://invisiblenetwork.ai/learn/nptel/111107137/5124dea549c4) (YouTube)
53. [Joint probability and covariance](https://invisiblenetwork.ai/learn/nptel/111107137/d7cab5f587af) (YouTube)
54. [Introduction to SVM](https://invisiblenetwork.ai/learn/nptel/111107137/9bc3fd4c0ac3) (YouTube)
55. [Error minimizing LPP](https://invisiblenetwork.ai/learn/nptel/111107137/e518bcec2b81) (YouTube)
56. [Concepts of Duality](https://invisiblenetwork.ai/learn/nptel/111107137/96c112df0cf0) (YouTube)
57. [Hard Margin Classifier](https://invisiblenetwork.ai/learn/nptel/111107137/c786ca1bd7ae) (YouTube)
58. [Soft Margin Classifier](https://invisiblenetwork.ai/learn/nptel/111107137/8e9bfa37be6b) (YouTube)
59. [SVM using Python-I](https://invisiblenetwork.ai/learn/nptel/111107137/4a33a2a15916) (YouTube)
60. [SVM using Python-II](https://invisiblenetwork.ai/learn/nptel/111107137/3b12e7b0758b) (YouTube)