# Applied Linear Algebra for Signal Processing, Data Analytics and Machine Learning

- Institution: IIT Kanpur
- Department: Electrical Engineering
- Teacher: Prof. Aditya K. Jagannatham
- Level: Undergraduate
- Language: English
- Subjects: Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/108104174)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/108104174)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

This course aims to introduce students to all the basic and advanced concepts in Linear Algebra with a strong focus on applications. Linear Algebra is one of the fundamental tools that has applications in diverse fields such as Machine Learning, Data Analytics, Signal Processing, Wireless Communication, Operations Research, Control and Finance. The various topics and applications that will be covered in different areas are as follows:

Wireless: MIMO/ OFDM systems, Beamforming, Channel Estimation

Machine Learning: Regression, Clustering, EM Algorithm, Perceptron, SVM/ Kernel SVM, Principal Component Analysis (PCA), Face recognition

Signal Processing: Signal Estimation, Regularization, Compressive Sensing, Image Compression, Robotics and Dynamical systems

Data Analytics: Recommender systems, Data completion, Data prediction, forecasting, Optimal Estimation, Financial models

Operations Resarch: Markov chains, inventory management, supply chain management

Miscellaneous Applications: Electrical circuits, Graph models and social networks, Traffic flow management

The course is suitable for all UG/PG students and practicing engineers/ scientists/ managers from the diverse fields mentioned above and interested in learning about the novel cutting edge applications of linear algebra in various fields such as Machine Learning, Data Analytics, Signal Processing, Wireless Communication.

Intended audience: -Students in Electrical Engineering, Electronics and Communication Engineering, Mathematics, Economics, Computer Science -Practicing engineers -Technical and Non-technical managers of Telecomm companies -Students preparing for Competitive Exams with focus on Wireless Communication, Signal Processing, Machine Learning - Students pursuing projects or research in Machine Learning, Data Analytics and Signal Processing/ Communication

## Lectures

1. [Lec 01- Vector Properties: Addition, Linear Combination, Inner Product, Orthogonality, Norm](https://invisiblenetwork.ai/learn/nptel/108104174/2d15cfb842c0) (YouTube)
2. [Lec 02- Vectors: Unit Norm Vector, Cauchy-Schwarz inequality, Radar Application](https://invisiblenetwork.ai/learn/nptel/108104174/6b07f910669b) (YouTube)
3. [Lec 03- Inner Product Application: Beamforming in Wireless Communication Systems](https://invisiblenetwork.ai/learn/nptel/108104174/87d2e9d49c2b) (YouTube)
4. [Lec 04- Matrices, Definition, Addition and Multiplication of Matrices](https://invisiblenetwork.ai/learn/nptel/108104174/1b9265a684eb) (YouTube)
5. [Lec 05- Matrix: Column Space, Linear Independence, Rank of Matrix, Gaussian Elimination](https://invisiblenetwork.ai/learn/nptel/108104174/e3e3c64a62b4) (YouTube)
6. [Lec 06- Matrix: Determinant, Inverse Computation, Adjoint, Cofactor Concepts](https://invisiblenetwork.ai/learn/nptel/108104174/696d7a20b869) (YouTube)
7. [Lec 07- Applications of Matrices: Solution of System of Linear equations, MIMO Wireless Technology](https://invisiblenetwork.ai/learn/nptel/108104174/ad66b79d8954) (YouTube)
8. [Lec 08- Applications of Matrices: Electric Circuits, Traffic flows](https://invisiblenetwork.ai/learn/nptel/108104174/979793919126) (YouTube)
9. [Lec 09- Applications of Matrices: Graph Theory, Social Networks, Dominance Directed Graph, Influential Node](https://invisiblenetwork.ai/learn/nptel/108104174/d5d7f0b5fdce) (YouTube)
10. [Lec 10- Null Space of Matrix: Definition, Rank-Nullity Theorem, Application in Electric Circuits](https://invisiblenetwork.ai/learn/nptel/108104174/823676def246) (YouTube)
11. [Lec 11- Gram-Schmidt Orthogonalization](https://invisiblenetwork.ai/learn/nptel/108104174/7b4f3f7d6d68) (YouTube)
12. [Lec 12- Gaussian Random Variable: Definition, Mean, Variance, Multivariate Gaussian, Covariance Matrix](https://invisiblenetwork.ai/learn/nptel/108104174/b74ea533ade1) (YouTube)
13. [Lec 13- Linear Transformation of Gaussian Random Vectors](https://invisiblenetwork.ai/learn/nptel/108104174/387646a354e6) (YouTube)
14. [Lec 14- Machine Learning Application: Gaussian Classification](https://invisiblenetwork.ai/learn/nptel/108104174/874dc3a286f5) (YouTube)
15. [Lec 15- Eigenvalue: Definition, Characteristic Equation, Eigenvalue Decomposition](https://invisiblenetwork.ai/learn/nptel/108104174/3cfab2bb8719) (YouTube)
16. [Lec 16- Special Matrices: Rotation and Unitary Matrices, Application: Alamouti Code](https://invisiblenetwork.ai/learn/nptel/108104174/fe827c8ac1bd) (YouTube)
17. [Lec 17- Positive Semi-definite (PSD) Matrices: Definition, Properties, Eigenvalue Decomposition](https://invisiblenetwork.ai/learn/nptel/108104174/a2bcfb4c4ac5) (YouTube)
18. [Lec 18- Positive Semidefinite Matrix: Example and Illustration of Eigenvalue Decomposition](https://invisiblenetwork.ai/learn/nptel/108104174/1b68f4684c3f) (YouTube)
19. [Lec 19- Machine Learning Application: Principal Component Analysis (PCA)](https://invisiblenetwork.ai/learn/nptel/108104174/6cb203df8d10) (YouTube)
20. [Lec 20- Computer Vision Application: Face Recognition, Eigenfaces](https://invisiblenetwork.ai/learn/nptel/108104174/aecde049135a) (YouTube)
21. [Lec 21- Least Squares (LS) Solution, Pseudo-Inverse Concept](https://invisiblenetwork.ai/learn/nptel/108104174/60374064c820) (YouTube)
22. [Lec 22- Least Squares (LS) via Principle of Orthogonality, Projection Matrix, Properties](https://invisiblenetwork.ai/learn/nptel/108104174/a99cab00c632) (YouTube)
23. [Lec 23- Application: Pseudo-Inverse and MIMO Zero Forcing (ZF) Receiver](https://invisiblenetwork.ai/learn/nptel/108104174/b4036ac3cfe1) (YouTube)
24. [Lec 24- Wireless Application: Multi-Antenna Channel Estimation](https://invisiblenetwork.ai/learn/nptel/108104174/654fae96018e) (YouTube)
25. [Lec 25- Machine Learning Application: Linear Regression](https://invisiblenetwork.ai/learn/nptel/108104174/24dbe496868d) (YouTube)
26. [Lec 26- Computation Mathematics Application: Polynomial Fitting](https://invisiblenetwork.ai/learn/nptel/108104174/776477f318d5) (YouTube)
27. [Lec 27- Least Norm Solution](https://invisiblenetwork.ai/learn/nptel/108104174/085ae58d549a) (YouTube)
28. [Lec 28- Wireless Application: Multi-user Beamforming](https://invisiblenetwork.ai/learn/nptel/108104174/f1ebb570f393) (YouTube)
29. [Lec 29- Singular Value Decomposition (SVD): Definition, Properties, Example](https://invisiblenetwork.ai/learn/nptel/108104174/903ad07fb6ea) (YouTube)
30. [Lec 30- SVD Application in MIMO Wireless Technology: Spatial-Multiplexing and High Data Rates](https://invisiblenetwork.ai/learn/nptel/108104174/ce0da59a2a75) (YouTube)
31. [Lec 31- SVD for MIMO wireless optimization, water-filling algorithm, optimal power allocation](https://invisiblenetwork.ai/learn/nptel/108104174/5044b0ce4270) (YouTube)
32. [Lec 32- SVD application for Machine Learning: Principal component analysis (PCA)](https://invisiblenetwork.ai/learn/nptel/108104174/e51210aa2cde) (YouTube)
33. [Lec 33- Multiple signal classification (MUSIC) algorithm: system model](https://invisiblenetwork.ai/learn/nptel/108104174/07055ccd9282) (YouTube)
34. [Lec 34- MUSIC algorithm for Direction of Arrival (DoA) estimation](https://invisiblenetwork.ai/learn/nptel/108104174/c1590498f362) (YouTube)
35. [Lec 35- Linear minimum mean square error (LMMSE) principle](https://invisiblenetwork.ai/learn/nptel/108104174/7906375505e5) (YouTube)
36. [Lec 36- LMMSE estimate and error covariance matrix](https://invisiblenetwork.ai/learn/nptel/108104174/7df8c6eb049c) (YouTube)
37. [Lec 37- LMMSE estimation in linear systems](https://invisiblenetwork.ai/learn/nptel/108104174/0b849ac7950d) (YouTube)
38. [Lec 38- LMMSE application: Wireless channel estimation and example](https://invisiblenetwork.ai/learn/nptel/108104174/7d26d5ebe646) (YouTube)
39. [Lec 39- Time-series prediction via auto-regressive (AR) model](https://invisiblenetwork.ai/learn/nptel/108104174/95da778cb5c3) (YouTube)
40. [Lec 40- Recommender system: design and rating prediction](https://invisiblenetwork.ai/learn/nptel/108104174/93027962ad47) (YouTube)
41. [Lec 41- Recommender system: Illustration via movie rating prediction example](https://invisiblenetwork.ai/learn/nptel/108104174/ff0bdb647faa) (YouTube)
42. [Lec 42- Fast Fourier transform (FFT) and Inverse fast Fourier transform (IFFT)](https://invisiblenetwork.ai/learn/nptel/108104174/5022e4309b9d) (YouTube)
43. [Lec 43- IFFT/ FFT application in Orthogonal Frequency Division Multiplexing (OFDM) wireless technology](https://invisiblenetwork.ai/learn/nptel/108104174/586fb7d7b4ac) (YouTube)
44. [Lec 44- OFDM system: Circulant matrices and properties](https://invisiblenetwork.ai/learn/nptel/108104174/01c9c1da5804) (YouTube)
45. [Lec 45- OFDM system model: Transmitter and receiver processing](https://invisiblenetwork.ai/learn/nptel/108104174/af7ff77e2946) (YouTube)
46. [Lec 46- Single-carrier frequency division for multiple access (SC-FDMA) technology](https://invisiblenetwork.ai/learn/nptel/108104174/23dd49854533) (YouTube)
47. [Lec 47- Linear dynamical systems: definition and solution via matrix exponential](https://invisiblenetwork.ai/learn/nptel/108104174/2fc585d45cd6) (YouTube)
48. [Lec 48- Linear dynamical systems: matrix exponential via SVD](https://invisiblenetwork.ai/learn/nptel/108104174/29fbcf98241d) (YouTube)
49. [Lec 49- Machine Learning application: Support Vector Machines (SVM)](https://invisiblenetwork.ai/learn/nptel/108104174/361463e6b58e) (YouTube)
50. [Lec 50- Support Vector Machines (SVM): Problem formulation via maximum hyperplane separation](https://invisiblenetwork.ai/learn/nptel/108104174/f6647f527a23) (YouTube)
51. [Lec 51- Sparse regression: problem formulation and relation to Compressive Sensing (CS)](https://invisiblenetwork.ai/learn/nptel/108104174/b50747668174) (YouTube)
52. [Lec 52- Sparse regression: solution via the Orthogonal Matching Pursuit (OMP) algorithm](https://invisiblenetwork.ai/learn/nptel/108104174/51f060e34672) (YouTube)
53. [Lec 53- OMP Example for Sparse Regression](https://invisiblenetwork.ai/learn/nptel/108104174/c786e0282759) (YouTube)
54. [Lec 54- Machine Learning Application: Clustering](https://invisiblenetwork.ai/learn/nptel/108104174/1fd99fc0a624) (YouTube)
55. [Lec 55- K-Means Clustering algorithm](https://invisiblenetwork.ai/learn/nptel/108104174/105c77c507db) (YouTube)
56. [Lec 56- Introduction to Stochastic Processes and Markov Chains](https://invisiblenetwork.ai/learn/nptel/108104174/825ca07bcf96) (YouTube)
57. [Lec 57- Discrete Time Markov Chains and Transition Probability Matrix](https://invisiblenetwork.ai/learn/nptel/108104174/0348ee887cbc) (YouTube)
58. [Lec 58- Discrete Time Markov Chain Examples](https://invisiblenetwork.ai/learn/nptel/108104174/af0d4d8a9128) (YouTube)
59. [Lec 59- m-STEP Transition Probabilities for Discrete Time Markov Chains](https://invisiblenetwork.ai/learn/nptel/108104174/73adefce5727) (YouTube)
60. [Lec 60- Limiting Behavior of Discrete Time Markov Chains](https://invisiblenetwork.ai/learn/nptel/108104174/04257b0a8524) (YouTube)
61. [Lec 61- Least Squares Revisited: Rank Deficient Matrix](https://invisiblenetwork.ai/learn/nptel/108104174/430f7b80df45) (YouTube)
62. [Lec 62- Least Squares using SVD](https://invisiblenetwork.ai/learn/nptel/108104174/32a997e90af6) (YouTube)
63. [Lec 63- Weighted Least Squares](https://invisiblenetwork.ai/learn/nptel/108104174/1f5ae33cbf23) (YouTube)
64. [Lec 64- Weighted Least Squares Example](https://invisiblenetwork.ai/learn/nptel/108104174/c935bc4a5998) (YouTube)
65. [Lec 65- Woodbury Matrix Identity – Matrix Inversion Lemma](https://invisiblenetwork.ai/learn/nptel/108104174/e189a531e45e) (YouTube)
66. [Lec 66- Woodbury Matrix Identity – Proof](https://invisiblenetwork.ai/learn/nptel/108104174/6f4356827760) (YouTube)
67. [Lec 67- Conditional Gaussian Density - Mean](https://invisiblenetwork.ai/learn/nptel/108104174/f5353b3fd643) (YouTube)
68. [Lec 68- Conditional Gaussian Density - Covariance](https://invisiblenetwork.ai/learn/nptel/108104174/fbb1efe9f8e2) (YouTube)
69. [Lec 69- Scalar Linear Model for Gaussian Estimation](https://invisiblenetwork.ai/learn/nptel/108104174/6a2220bc4162) (YouTube)
70. [Lec 70- MMSE Estimate and Covariance for the Scalar Linear Model](https://invisiblenetwork.ai/learn/nptel/108104174/df50f15c3928) (YouTube)