# THE SUCCESS OF DEEP GENERATIVE MODELS

- Institution: CERN
- Department: EP-IT Data science seminars
- Speaker: Jakub Tomczak
- Year: 2018
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3003533)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Deep generative models allow us to learn hidden representations of data and generate new examples. There are two major families of models that are exploited in current applications: Generative Adversarial Networks (GANs), and Variational Auto-Encoders (VAE). The principle of GANs is to train a generator that can generate examples from random noise, in adversary of a discriminative model that is forced to confuse true samples from generated ones. Generated images by GANs are very sharp and detailed. The biggest disadvantage of GANs is that they are trained through solving a minimax optimization problem that causes significant learning instability issues. VAEs are based on a fully probabilistic perspective of the variational inference. The learning problem aims at maximizing the variational lower bound for a given family of variational posteriors. The model can be trained by backpropagation but it was noticed that the resulting generated images are rather blurry. However, VAEs are probabilistic models, thus, they could be incorporated in almost any probabilistic framework. We will discuss basics of both approaches and present recent extensions. We will point out advantages and disadvantages of GANs and VAE. Some of most promising applications of deep generative models will be shown. .

0:00:00 Slide 1

0:01:34 Slide 2

0:01:42 Slide 3

0:01:56 Slide 4

0:02:52 Slide 5

0:03:15 Slide 6

0:04:08 Slide 7

0:05:21 Slide 8

0:07:18 Slide 9

0:08:39 Slide 10

0:10:38 Slide 11

0:12:11 Slide 12

0:14:06 Slide 13

0:15:45 Slide 14

0:17:43 Slide 15

0:19:46 Slide 16

0:21:47 Slide 17

0:23:10 Slide 18

0:24:23 Slide 19

0:24:53 Slide 20

0:25:09 Slide 21

0:25:14 Slide 22

0:25:52 Slide 23

0:27:54 Slide 24

0:28:14 Slide 25

0:28:42 Slide 26

0:30:21 Slide 27

0:30:57 Slide 28

0:31:07 Slide 29

0:31:18 Slide 30

0:31:22 Slide 31

0:31:51 Slide 32

0:32:02 Slide 33

0:32:11 Slide 34

0:32:47 Slide 35

0:32:53 Slide 36

0:33:33 Slide 37

0:33:46 Slide 38

0:34:04 Slide 39…

## Lectures

1. [THE SUCCESS OF DEEP GENERATIVE MODELS](https://invisiblenetwork.ai/learn/cern/3003533/4f64be709e30), 54 min (CERN's player)