Learn · Information Theory and Coding

Lecture 6 of 41Information Theory and Coding

L6-Asymptotic Properties of Entropy and Problem Solving in Entropy

Prof. S.N. Merchant · IIT Bombay

Credits and licence

From
Information Theory and Coding, IIT Bombay (at NPTEL)
Licence
CC BY-NC-SA, as NPTEL states it. Non-commercial use only.
Attribution
NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
Who can watch
Teens profiles and older. How courses are placed

All the lectures

  1. L1- Introduction to Information Theory and Coding Video
  2. L2-Definition of Information Measure and Entropy Video
  3. L3-Extention of An Information Source and Markov Source Video
  4. L4-Adjoint of An Information Source, Joint and Conditional Information Measure Video
  5. L5-Properties of Joint and Conditional Information Measures and A Morkov Source Video
  6. L6-Asymptotic Properties of Entropy and Problem Solving in Entropy Video
  7. L7-Block Code and its Properties Video
  8. L8-Instantaneous Code and Its Properties Video
  9. L9-Kraft-Mcmillan Equality and Compact Codes Video
  10. L10-Shannon's First Theorem Video
  11. L11-Coding Strategies and Introduction to Huffman Coding Video
  12. L12-Huffman Coding and Proof of Its Optamality Video
  13. L13-Competitive Optamality of The Shannon Code Video
  14. L14-Non-Binary Huffman Code and Other Codes Video
  15. L15-Adaptive Huffman Coding Part-I Video
  16. L16-Adaptive Huffman Coding Part-II Video
  17. L17-Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding Video
  18. L18-Arithmetic Coding Part-I Video
  19. L19-Arithmetic Coding Part-II Video
  20. L20-Introdution to Information Channels Video
  21. L21-Equivocation and Mutual Information Video
  22. L22-Properties of Different Information Channels Video
  23. L23-Reduction of Information Channels Video
  24. L24-Properties of Mutual Information and Introdution to Channel Capacity Video
  25. L25-Calculation of Channel Capacity for Different Information Channels Video
  26. L26-Shannon's Second Theorem Video
  27. L27-Discussion On Error Free Communication Over Noisy Channel Video
  28. L28-Error Free Communication Over A Binary Symmetric Channel and Introdution to Continous Sources and Channels Video
  29. L29-Differential Entropy and Evaluation of Mutual Information for Continuous Sources and Channels Video
  30. L30-Channel Capacity of A BandLimited Continuous Channel Video
  31. L31-Introduction to Rate-Distortion Theory Video
  32. L32-Definition and Properties of Rate-Distortion Functions Video
  33. L33-Calculation of Rate-Distortion Functions Video
  34. L34-Computational Approach for Calculation of Rate-Distortion Functions Video
  35. L35-Introdution to Quantization Video
  36. L36-Lloyd-Max Quantizer Video
  37. L37-Companded Quantization Video
  38. L38-Variable Length Coding and Problem Solving in Quantizer Design Video
  39. L39-Vector Quantization Video
  40. L40-Transform Coding Part-I Video
  41. L41-Transform Coding Part-II Video