# Automatic Differentiation and Deep Learning

- Institution: CERN
- Department: EP-IT Data science seminars
- Speaker: Soumith Chintala
- Year: 2018
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3004260)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Statistical learning has been getting more and more interest from the particle-physics community in recent times, with neural networks and gradient-based optimization being a focus.

In this talk we shall discuss three things:

automatic differention tools: tools to quickly build DAGs of computation that are fully differentiable. We shall focus on one such tool "PyTorch".

Easy deployment of trained neural networks into large systems with many constraints: for example, deploying a model at the reconstruction phase where the neural network has to be integrated into CERN's bulk data-processing C++-only environment

Some recent models in deep learning for segmentation and generation that might be useful for particle physics problems.

.

0:00:00 Slide 1

0:03:33 Slide 2

0:05:32 Slide 3

0:05:43 Slide 4

0:06:03 Slide 5

0:07:16 Slide 6

0:07:47 Slide 7

0:07:58 Slide 8

0:08:31 Slide 9

0:09:20 Slide 10

0:09:24 Slide 11

0:09:35 Slide 12

0:10:15 Slide 13

0:11:07 Slide 14

0:11:25 Slide 15

0:11:29 Slide 16

0:11:48 Slide 17

0:12:25 Slide 18

0:12:33 Slide 19

0:13:00 Slide 20

0:13:14 Slide 21

0:13:35 Slide 22

0:14:16 Slide 23

0:14:40 Slide 24

0:15:28 Slide 25

0:15:43 Slide 26

0:15:49 Slide 27

0:16:02 Slide 28

0:16:11 Slide 29

0:16:24 Slide 30

0:16:44 Slide 31

0:18:33 Slide 32

0:18:39 Slide 33

0:18:58 Slide 34

0:19:14 Slide 35

0:19:20 Slide 36

0:19:28 Slide 37

0:19:33 Slide 38

0:19:50 Slide 39

0:19:57 Slide 40

0:20:05 Slide 41

0:20:50 Slide 42

0:20:54 Slide 43

0:21:14 Slide 44

0:21:23 Slide 45

0:22:17 Slide 46

0:22:49 Slide 47

0:22:58 Slide 48

0:23:18 Slide 49

0:24:05 Slide 50

0:24:52 Slide 51

0:25:15 Slide 52

0:25:36 Slide 53

0:27:16 Slide 54

0:27:38 Slide 55

0:29:10 Slide 56

0:29:23 Slide 57

0:30:32 Slide 58

0:31:31 Slide 59

0:31:50 Slide 60

0:34:22 Slide 61

0:34:35 Slide 62

0:34:51 Slide 63

0:35:11 Slide 64

0:35:27 Slide 65

0:36:31 Slide 66

0:37:42 Slide 67

0:37:58 Slide 68

0:38:25 Slide 69

0:38:53 Slide 70…

## Lectures

1. [Automatic Differentiation and Deep Learning](https://invisiblenetwork.ai/learn/cern/3004260/cd89af141e08), 58 min (CERN's player)