Learn · Concentration Inequalities
Lecture 13 of 27week-05
mod05lec13 A modified log-Sobolev inequality and concentration
Prof. Aditya Gopalan Prof. Himanshu tyagi · IISc Bangalore
Credits and licence
- From
- Concentration Inequalities, IISc Bangalore (at NPTEL)
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only.
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
- Who can watch
- Tweens profiles and older. How courses are placed
All the lectures
- mod01lec01 Why study concentration inequalities?
- mod01lec02 Chernoff bound
- mod01lec03 Examples of Chernoff bound for common distributions
- mod02lec04 Hoeffding and Bernstein inequalities
- mod02lec05 Azuma and McDiarmid inequalities
- mod03lec06 Bounding variance using the Efron-Stein inequality
- mod03lec07 The Gaussian-Poincare inequality
- mod03lec08 Tail bounds using the Efron-Stein inequality
- mod04lec09 Herbst's argument and the entropy method
- mod04lec10 Log-Sobolev inequalities
- mod04lec11 Binary and Gaussian Log-Sobolev inequalities and concentration
- mod05lec12 Variational formulae forKullback-Leibler and Bregman Divergence
- mod05lec13 A modified log-Sobolev inequality and concentration
- mod05lec14 Introduction to the transportation method for showing concentration bounds
- mod05lec15 Transportationlemma and a proof of McDiarmid's inequality using the transportation method
- mod06lec16 Concentration bounds for functions beyond bounded difference using transportation method
- mod06lec17 Marton's conditional transportation cost inequality
- mod06lec18 Isoperimetry and concentration of measure
- mod06lec19 Isoperimetry and bounded difference
- mod07lec20 Equivalence of Stam's inequality and log Sobolev inequality
- mod07lec21 An information theoretic proof of log Sobolev inequality
- mod07lec22 Hypercontractivity and strong data processing inequality for Rényi divergence
- mod07lec23 An information theoretic characterization of hypercontractivity
- mod07lec24 Equivalence of Gaussian hypercontractivity and Gaussian log Sobolev inequality
- mod08lec25 Uniform deviation bounds for random walks and the law of the iterated logarithm
- mod08lec26 Self normalized concentration inequalities and application to online regression
- Live Session 22-09-2021