# An Introduction to Information Theory

- Institution: IIT Kanpur
- Department: Electronics & Communication Engineering
- Teacher: Prof. Adrish Banerjee
- Level: Undergraduate
- Language: English
- Subjects: Engineering, Society and politics
- Source: [NPTEL](https://nptel.ac.in/courses/117104129)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/117104129)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

## Lectures

1. [Introduction](https://invisiblenetwork.ai/learn/nptel/117104129/dd340dc76a4e) (Video)
2. [Measure of Information](https://invisiblenetwork.ai/learn/nptel/117104129/194b255e83f1) (Video)
3. [Information Inequalities](https://invisiblenetwork.ai/learn/nptel/117104129/20b251ba1c1f) (Video)
4. [Problem solving session-I](https://invisiblenetwork.ai/learn/nptel/117104129/3418ce6a3ea1) (Video)
5. [Block to Variable Length Coding I : Prefix-free code](https://invisiblenetwork.ai/learn/nptel/117104129/a121d116e006) (Video)
6. [Block to Variable Length Coding II : Bounds on Optimal Code Length](https://invisiblenetwork.ai/learn/nptel/117104129/55dc307e1028) (Video)
7. [Block to Variable Length Coding III : Huffman Coding](https://invisiblenetwork.ai/learn/nptel/117104129/c136428858af) (Video)
8. [Variable to block length coding](https://invisiblenetwork.ai/learn/nptel/117104129/1e67abe5fc65) (Video)
9. [The asymptotic equipartition property](https://invisiblenetwork.ai/learn/nptel/117104129/399810344c70) (Video)
10. [Block to block coding of DMS](https://invisiblenetwork.ai/learn/nptel/117104129/7573ef28a014) (Video)
11. [Problem solving session-II](https://invisiblenetwork.ai/learn/nptel/117104129/9e896f27d89f) (Video)
12. [Universal Source Coding-I: Lempel-Ziv Algorithm-LZ77](https://invisiblenetwork.ai/learn/nptel/117104129/7bde0473c7c5) (Video)
13. [Universal source coding-II: Lempel-Ziv Welch Algorithm (LZW)](https://invisiblenetwork.ai/learn/nptel/117104129/da1352fc0f1a) (Video)
14. [Coding of sources with memory](https://invisiblenetwork.ai/learn/nptel/117104129/db634a476346) (Video)
15. [Channel Capacity](https://invisiblenetwork.ai/learn/nptel/117104129/bbb612bf8b66) (Video)
16. [Joint typical sequences](https://invisiblenetwork.ai/learn/nptel/117104129/2a1108b383dc) (Video)
17. [Noisy channel coding theorem](https://invisiblenetwork.ai/learn/nptel/117104129/7a7763c21304) (Video)
18. [Differential entropy](https://invisiblenetwork.ai/learn/nptel/117104129/5afc0ad3a38c) (Video)
19. [Gaussian channel](https://invisiblenetwork.ai/learn/nptel/117104129/1273fac58b8f) (Video)
20. [Parallel Gaussian channel](https://invisiblenetwork.ai/learn/nptel/117104129/90e5e2b832ce) (Video)
21. [Problem solving session-III](https://invisiblenetwork.ai/learn/nptel/117104129/59798396e02b) (Video)
22. [Rate distortion theory](https://invisiblenetwork.ai/learn/nptel/117104129/9bc07fe41961) (Video)
23. [Blahut-Arimoto Algorithm](https://invisiblenetwork.ai/learn/nptel/117104129/4ff4275de738) (Video)
24. [Problem solving session-IV](https://invisiblenetwork.ai/learn/nptel/117104129/b95df1d33da2) (Video)
25. [Live Session 02-03-2024](https://invisiblenetwork.ai/learn/nptel/117104129/dd340dc76a4e-2) (Video)