Learn · NPTEL

Course11710412925 lectures

An Introduction to Information Theory

Prof. Adrish Banerjee · IIT Kanpur

Start with lecture 1 At NPTEL

Lectures

Week 1

  1. Introduction Video
  2. Measure of Information Video
  3. Information Inequalities Video
  4. Problem solving session-I Video

Week 2

  1. Block to Variable Length Coding I : Prefix-free code Video
  2. Block to Variable Length Coding II : Bounds on Optimal Code Length Video
  3. Block to Variable Length Coding III : Huffman Coding Video

Week 3

  1. Variable to block length coding Video
  2. The asymptotic equipartition property Video
  3. Block to block coding of DMS Video

Week 4

  1. Problem solving session-II Video
  2. Universal Source Coding-I: Lempel-Ziv Algorithm-LZ77 Video
  3. Universal source coding-II: Lempel-Ziv Welch Algorithm (LZW) Video

Week 5

  1. Coding of sources with memory Video
  2. Channel Capacity Video

Week 6

  1. Joint typical sequences Video
  2. Noisy channel coding theorem Video
  3. Differential entropy Video

Week 7

  1. Gaussian channel Video
  2. Parallel Gaussian channel Video
  3. Problem solving session-III Video

Week 8

  1. Rate distortion theory Video
  2. Blahut-Arimoto Algorithm Video
  3. Problem solving session-IV Video

Live Session

  1. Live Session 02-03-2024 Video

Syllabus and materials

At NPTEL, as the course publishes them.

Credits and licence

Institution
IIT Kanpur
Department
Electronics & Communication Engineering
Teacher
Prof. Adrish Banerjee
Level
Undergraduate
Language
English
Subjects
Engineering, Society and politics
Source
NPTEL
Licence
CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
Attribution
NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
Who can watch
NPTEL gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed