Learn · Deep Learning - Part 2
Lecture 10 of 37Week 2
Bayesian Networks : Formal Semantics
Prof. Mitesh M. Khapra · IIT Madras
Credits and licence
- From
- Deep Learning - Part 2, IIT Madras (at NPTEL)
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only.
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
- Who can watch
- Tweens profiles and older. How courses are placed
All the lectures
- Recap of Probability Theory
- Why are we interested in Joint Distributions
- How do we represent a joint distribution
- Can we represent the joint distribution more compactly
- Can we use a graph to represent a joint distribution
- Different types of reasoning encoded in a Bayesian Network
- Independencies encoded by a Bayesian Network(Case 1: Node and it's parents)
- Independencies encoded by a Bayesian Network(Case 2: Node and it's non-parents)
- Independencies encoded by a Bayesian Network(Case 3: Node and it's descendants)
- Bayesian Networks : Formal Semantics
- I-Maps
- Markov Networks: Motivation
- Factors in Markov Network
- Local Independencies in a Markov Network
- Joint Distributions
- The concept of a latent variable
- Restricted Boltzmann Machines
- RBMs as Stochastic Neural Networks
- Unsupervised Learning with RBMs
- Computing the gradient of the log likelihood
- Motivation for Sampling
- Motivation for Sampling - Part - 02
- Markov Chains
- Why de we care about Markov Chains ?
- Setting up a Markov Chain for RBMs
- Training RBMs Using Gibbs Sampling
- Training RBMS Using Contrastive Divergence
- Revisiting Autoencoders
- Variational Autoencoders: The Neural Network Perspective
- Variational Autoencoders: The Graphical model perspective
- Neural Autoregressive Density Estimator
- Masked Autoencoder Density Estimator (MADE)
- Generative Adversarial Networks - The Intuition
- Generative Adversarial Networks - Architecture
- Generative Adversarial Networks - The Math Behind it
- Generative Adversarial Networks - Some Cool Stuff and Applications
- Bringing it all together (the deep generative summary)