# Beyond Pick and Place - Tackling Robotic Stacking of Diverse Shapes

- Institution: CERN
- Department: EP-IT Data science seminars
- Speaker: Coline Devin
- Year: 2022
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3014144)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Applying deep learning to robotics is difficult for many reasons; challenges include collecting data at scale, reproducing experiments, and training models that are robust to varying environments. In this talk, I will discuss our new object stacking benchmark task. We generate a challenging and diverse set of objects, selected to require strategies beyond a simple "pick-and-place" solution. In a large experimental study based on this benchmark, we investigate what choices matter for learning vision-based agents in simulated environments, and what factors affect transfer from the simulated to the real robot. Finally, we develop reinforcement learning algorithms to efficiently transfer behaviours from one set of objects to another and from simulation to the real world, given a fixed data budget.

Coline Devin is a research scientist at DeepMind. Her research focuses on reinforcement learning and imitation learning for robotics both in simulation and in the real world. She received her PhD from the University of California, Berkeley where she worked on deep learning methods for compositional robotic agents. .

0:00:00 Slide 1

0:02:17 Slide 2

0:03:37 Slide 3

0:05:26 Slide 4

0:06:39 Slide 5

0:08:37 Slide 6

0:09:46 Slide 7

0:12:31 Slide 8

0:13:43 Slide 9

0:16:47 Slide 10

0:19:08 Slide 11

0:21:06 Slide 12

0:22:26 Slide 13

0:23:56 Slide 14

0:26:50 Slide 15

0:29:19 Slide 16

0:31:04 Slide 17

0:32:50 Slide 18

0:38:33 Slide 19

0:39:49 Slide 20

0:46:46 Slide 21

0:50:41 Slide 22

## Lectures

1. [Beyond Pick and Place - Tackling Robotic Stacking of Diverse Shapes](https://invisiblenetwork.ai/learn/cern/3014144/830ca86f7f2c), 53 min (CERN's player)