# Ad-hoc filesystems for dynamic science workloads

- Institution: CERN
- Department: Ceph Project
- Taught by: John Garbutt, Stig Telfer
- Year: 2019
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3002364)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

In this talk, we present recent work supporting the computing demands of the Euclid space mission using resources from across an OpenStack federation for scientific computing. CephFS is used to present a single coherent filesystem drawing upon resources from multiple sites. We present our approach and experiences.

We then present an alternative approach to filesystems on-the-fly using the Data Accelerator project at Cambridge University, currently #1 in the global IO-500 list. We provide an overview of the technologies involved and an analysis of how its high performance levels are achieved..

0:00:00 Slide 1

0:00:18 Slide 2

0:00:30 Slide 3

0:00:41 Slide 4

0:01:24 Slide 5

0:03:01 Slide 6

0:04:38 Slide 7

0:05:33 Slide 8

0:05:59 Slide 9

0:06:46 Slide 10

0:07:26 Slide 11

0:08:57 Slide 12

0:09:38 Slide 13

0:10:34 Slide 14

0:11:11 Slide 15

0:12:47 Slide 16

0:13:15 Slide 17

0:14:06 Slide 18

0:15:33 Slide 19

0:15:56 Slide 20

0:16:30 Slide 21

0:16:54 Slide 22

0:17:21 Slide 23

0:17:25 Slide 24

0:18:46 Slide 25

0:20:21 Slide 26

0:22:45 Slide 27

0:22:49 Slide 28

0:22:59 Slide 29

0:23:19 Slide 30

0:23:49 Slide 31

0:23:54 Slide 32

0:24:19 Slide 33

0:24:42 Slide 34

0:24:46 Slide 35

0:26:03 Slide 36

0:26:43 Slide 37

0:27:11 Slide 38

0:27:23 Slide 39

## Lectures

1. [Ad-hoc filesystems for dynamic science workloads](https://invisiblenetwork.ai/learn/cern/3002364/c02a5c14f6c5), 28 min (CERN's player)