# Probability Foundations for Electrical Engineers

- Institution: IIT Madras
- Department: Electrical Engineering
- Teacher: Prof. Krishna Jagannathan
- Level: Undergraduate
- Language: English
- Subjects: Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/108106083)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/108106083)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

This is a graduate level class on probability theory, geared towards students who are interested in a rigorous development of the subject. It is likely to be useful for students specializing in communications, networks, signal processing, stochastic control, machine learning, and related areas. In general, the course is not so much about computing probabilities, expectations, densities etc. Instead, we will focus on the ‘nuts and bolts’ of probability theory and aim to develop a more intricate understanding of the subject. For example, emphasis will be placed on deriving and proving fundamental results, starting from the basic axioms.

INTENDED AUDIENCE : M.Tech/M.S/PhD students, who plan to specialize in communications, networks, signal processing, stochastic control, machine learning, or related areas.

PREREQUISITES : There will be no official pre-requisites. Although the course will build up from the basics, it will be taught at a fairly sophisticated level. Familiarity with concepts from real analysis will also be useful. Perhaps the most important prerequisite for this class is an intangible one, namely mathematical maturity.

## Lectures

1. [Introduction](https://invisiblenetwork.ai/learn/nptel/108106083/07743f9b9d6c) (YouTube)
2. [Cardinality](https://invisiblenetwork.ai/learn/nptel/108106083/af6920b01f7b) (YouTube)
3. [Countability](https://invisiblenetwork.ai/learn/nptel/108106083/98c5e83c24a6) (YouTube)
4. [Uncountable sets-1](https://invisiblenetwork.ai/learn/nptel/108106083/5a72d4844a7e) (YouTube)
5. [Uncountable sets-2](https://invisiblenetwork.ai/learn/nptel/108106083/25dcc3e1bdd9) (YouTube)
6. [Probability spaces-Introduction](https://invisiblenetwork.ai/learn/nptel/108106083/d8590afe48c4) (YouTube)
7. [Probability spaces-Algebra](https://invisiblenetwork.ai/learn/nptel/108106083/3e7bec359d8b) (YouTube)
8. [Probability spaces-σ-algebra](https://invisiblenetwork.ai/learn/nptel/108106083/0eb8b6ec0879) (YouTube)
9. [Probability spaces-Measurable space](https://invisiblenetwork.ai/learn/nptel/108106083/035f005e193b) (YouTube)
10. [Properties of probability measures](https://invisiblenetwork.ai/learn/nptel/108106083/3b8b9e6af015) (YouTube)
11. [Continuity of probability measure](https://invisiblenetwork.ai/learn/nptel/108106083/9a02daf6567f) (YouTube)
12. [Discrete probability space-finite and countably infinite sample space](https://invisiblenetwork.ai/learn/nptel/108106083/036cbd4c2b1a) (YouTube)
13. [Discrete probability space-Uncountable sample space](https://invisiblenetwork.ai/learn/nptel/108106083/5da459a6bf7b) (YouTube)
14. [Generated σ-algebra, Borel Sets](https://invisiblenetwork.ai/learn/nptel/108106083/05c82474b600) (YouTube)
15. [Borel sets](https://invisiblenetwork.ai/learn/nptel/108106083/15a998537bd1) (YouTube)
16. [Uniform probability measure on Borel sets-Lebesgue measure](https://invisiblenetwork.ai/learn/nptel/108106083/e9bc01dd2207) (YouTube)
17. [Carathéodory’s extension theorem](https://invisiblenetwork.ai/learn/nptel/108106083/11c3f35c59bc) (YouTube)
18. [Lebesgue measure (contd)](https://invisiblenetwork.ai/learn/nptel/108106083/c2d39c46ef36) (YouTube)
19. [Infinite coin toss model](https://invisiblenetwork.ai/learn/nptel/108106083/8d80d71415fa) (YouTube)
20. [Infinite coin toss model (Contd)](https://invisiblenetwork.ai/learn/nptel/108106083/7da2a2ae9ec9) (YouTube)
21. [Conditional probability](https://invisiblenetwork.ai/learn/nptel/108106083/78a792b986ff) (YouTube)
22. [Properties of conditional probability](https://invisiblenetwork.ai/learn/nptel/108106083/bad1554b5b9c) (YouTube)
23. [Independence of events](https://invisiblenetwork.ai/learn/nptel/108106083/e8cf33d3c40f) (YouTube)
24. [Independence of σ-algebras](https://invisiblenetwork.ai/learn/nptel/108106083/cc6a7802dc70) (YouTube)
25. [Borel-Cantelli Lemma 1](https://invisiblenetwork.ai/learn/nptel/108106083/8d5dd6376879) (YouTube)
26. [Borel-Cantelli Lemma 2](https://invisiblenetwork.ai/learn/nptel/108106083/532d3a434272) (YouTube)
27. [Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/0f79205f4594) (YouTube)
28. [Random Variables (Contd)](https://invisiblenetwork.ai/learn/nptel/108106083/67fbdbefda9c) (YouTube)
29. [Cumulative Distribution Function](https://invisiblenetwork.ai/learn/nptel/108106083/f72d9fe32689) (YouTube)
30. [Properties of CDF](https://invisiblenetwork.ai/learn/nptel/108106083/78767b585309) (YouTube)
31. [Types of Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/5af880e665e3) (YouTube)
32. [Examples of Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/dcc18902fad8) (YouTube)
33. [Continuous Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/d8610f0572fe) (YouTube)
34. [Examples of Continuous Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/2a612d718030) (YouTube)
35. [Continuous Random Variables - 2,Examples of Continuous RandomVariables - 2](https://invisiblenetwork.ai/learn/nptel/108106083/bec350c9b17d) (YouTube)
36. [Singular Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/1b3dc59d9b0c) (YouTube)
37. [Several Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/6b37d40b860c) (YouTube)
38. [Several Random Variables - 2](https://invisiblenetwork.ai/learn/nptel/108106083/f3c30de2b628) (YouTube)
39. [Independent Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/ef83cb1cfe65) (YouTube)
40. [Indiependent Random Variables - 2](https://invisiblenetwork.ai/learn/nptel/108106083/566ffbf364f8) (YouTube)
41. [Conditional PMF, Jointly Continuous Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/6ae410e85e92) (YouTube)
42. [Jointly Continous RandomVariables - 2](https://invisiblenetwork.ai/learn/nptel/108106083/f08954402dbf) (YouTube)
43. [Jointly Continuous RandomVariables - 3](https://invisiblenetwork.ai/learn/nptel/108106083/75d6d6bf5506) (YouTube)
44. [Conditional CDF](https://invisiblenetwork.ai/learn/nptel/108106083/7498d1706642) (YouTube)
45. [Transformation of RandomVariables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/a906626f80d5) (YouTube)
46. [Transformation of RandomVariables - 2; IndependentRandom Variables](https://invisiblenetwork.ai/learn/nptel/108106083/bac39a2be847) (YouTube)
47. [Sums of Discrete RandomVariables](https://invisiblenetwork.ai/learn/nptel/108106083/b68d4c1d0c72) (YouTube)
48. [Sums of Jointly ContinuousRandom Variables](https://invisiblenetwork.ai/learn/nptel/108106083/84255028cd7c) (YouTube)
49. [Sums of Random Number of Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/e561d7cf17b2) (YouTube)
50. [General Transformations of Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/b87bd59b6e80) (YouTube)
51. [Jacobian Formula](https://invisiblenetwork.ai/learn/nptel/108106083/1296d3f29ecb) (YouTube)
52. [Examples Illustrating the use of Jacobian Formula](https://invisiblenetwork.ai/learn/nptel/108106083/aa158ce27af0) (YouTube)
53. [Introduction Integral and Expectation](https://invisiblenetwork.ai/learn/nptel/108106083/04819ca51741) (YouTube)
54. [Definition of the Abstract Integral](https://invisiblenetwork.ai/learn/nptel/108106083/13836f5cdf4c) (YouTube)
55. [Simple Functions](https://invisiblenetwork.ai/learn/nptel/108106083/e6f544f45993) (YouTube)
56. [Computing Expectation using Simple Functions, Properties of Integrals](https://invisiblenetwork.ai/learn/nptel/108106083/49e2f24cdd5d) (YouTube)
57. [Properties of Integrals (Contd.)](https://invisiblenetwork.ai/learn/nptel/108106083/bede28169aea) (YouTube)
58. [Inclusion Exclusion Formula using Indicator RVs and Expectation](https://invisiblenetwork.ai/learn/nptel/108106083/89e9dcd5c3cc) (YouTube)
59. [Monotone Convergence Theorem - 1](https://invisiblenetwork.ai/learn/nptel/108106083/dc94882384e9) (YouTube)
60. [Monotone Convergence Theorem - 2](https://invisiblenetwork.ai/learn/nptel/108106083/ef83acab2da7) (YouTube)
61. [Expectation of a Discrete Random Variable](https://invisiblenetwork.ai/learn/nptel/108106083/202d785b6903) (YouTube)
62. [Examples of Expectation of Discrete Random Variables](https://invisiblenetwork.ai/learn/nptel/108106083/eae4f1c2350f) (YouTube)
63. [Expectation of Function of Random Variable](https://invisiblenetwork.ai/learn/nptel/108106083/50ae5c2d2b2d) (YouTube)
64. [Some Examples of Computing Expectation](https://invisiblenetwork.ai/learn/nptel/108106083/01d49a61021d) (YouTube)
65. [Fatou’s Lemma](https://invisiblenetwork.ai/learn/nptel/108106083/b818d3e1da9a) (YouTube)
66. [Dominated Convergence Theorem](https://invisiblenetwork.ai/learn/nptel/108106083/a73d51d071af) (YouTube)
67. [Variance](https://invisiblenetwork.ai/learn/nptel/108106083/c8674adbfb50) (YouTube)
68. [Covariance](https://invisiblenetwork.ai/learn/nptel/108106083/9056df4a4822) (YouTube)
69. [Covariance Correlation Coefficient - 1](https://invisiblenetwork.ai/learn/nptel/108106083/7036523ac933) (YouTube)
70. [Covariance Correlation Coefficient - 2](https://invisiblenetwork.ai/learn/nptel/108106083/1e5925bcb36b) (YouTube)
71. [Conditional Expectation](https://invisiblenetwork.ai/learn/nptel/108106083/ded95b6bdaa2) (YouTube)
72. [Properties of Conditional Expectation](https://invisiblenetwork.ai/learn/nptel/108106083/833713967f4b) (YouTube)
73. [MMSE Estimator](https://invisiblenetwork.ai/learn/nptel/108106083/89f2f4bd7405) (YouTube)
74. [Transforms](https://invisiblenetwork.ai/learn/nptel/108106083/3eb52dcd4a3d) (YouTube)
75. [Moment Generating Function - 1](https://invisiblenetwork.ai/learn/nptel/108106083/9ec3443e672a) (YouTube)
76. [Moment Generating Function - 2](https://invisiblenetwork.ai/learn/nptel/108106083/7bed37ae5f2e) (YouTube)
77. [Characteristic Function - 1](https://invisiblenetwork.ai/learn/nptel/108106083/fc816fa81f90) (YouTube)
78. [Characteristic Function - 2](https://invisiblenetwork.ai/learn/nptel/108106083/07e22517d963) (YouTube)
79. [Characteristic Function - 3](https://invisiblenetwork.ai/learn/nptel/108106083/08da7a165d49) (YouTube)
80. [Characteristic Function - 4](https://invisiblenetwork.ai/learn/nptel/108106083/55260282a066) (YouTube)
81. [Concentration Inequalities - 1](https://invisiblenetwork.ai/learn/nptel/108106083/22ec9d71e93b) (YouTube)
82. [Concentration Inequalities - 2](https://invisiblenetwork.ai/learn/nptel/108106083/be2e58991f88) (YouTube)
83. [Convergence of Random Variables - 1](https://invisiblenetwork.ai/learn/nptel/108106083/0f0dda39eae8) (YouTube)
84. [Convergence of Random Variables - 2](https://invisiblenetwork.ai/learn/nptel/108106083/55be5b7db377) (YouTube)
85. [Convergence of Random Variables - 3](https://invisiblenetwork.ai/learn/nptel/108106083/3a5c2c9b2dbc) (YouTube)
86. [Convergence of Random Variables - 4](https://invisiblenetwork.ai/learn/nptel/108106083/106ad2a6a36b) (YouTube)
87. [Convergence of Random Variables - 5](https://invisiblenetwork.ai/learn/nptel/108106083/6d2e88aef5bb) (YouTube)
88. [Convergence of Random Variables - 6](https://invisiblenetwork.ai/learn/nptel/108106083/a814d37478d8) (YouTube)
89. [Convergence Of Characteristic Functions](https://invisiblenetwork.ai/learn/nptel/108106083/8dafebaf44dd) (YouTube)
90. [Limit Theorems](https://invisiblenetwork.ai/learn/nptel/108106083/e1fb1701cde8) (YouTube)
91. [The Law of Large Numbers - 1](https://invisiblenetwork.ai/learn/nptel/108106083/0ee588502892) (YouTube)
92. [The Law of Large Numbers - 2](https://invisiblenetwork.ai/learn/nptel/108106083/f2da9bb73f74) (YouTube)
93. [The Central Limit Theorem - 1](https://invisiblenetwork.ai/learn/nptel/108106083/b18d9753c26b) (YouTube)
94. [The Central Limit Theorem - 2](https://invisiblenetwork.ai/learn/nptel/108106083/d1550ac3354c) (YouTube)
95. [A Brief Overview of Multivariate Gaussians - 1](https://invisiblenetwork.ai/learn/nptel/108106083/963c5b6a6269) (YouTube)
96. [A Brief Overview of Multivariate Gaussians - 2](https://invisiblenetwork.ai/learn/nptel/108106083/376b8d1e70f6) (YouTube)