Learn · CERN

Talk28 min

Ad-hoc filesystems for dynamic science workloads

John Garbutt and Stig Telfer · CERN

Watch At CERN

About

In this talk, we present recent work supporting the computing demands of the Euclid space mission using resources from across an OpenStack federation for scientific computing. CephFS is used to present a single coherent filesystem drawing upon resources from multiple sites. We present our approach and experiences.

We then present an alternative approach to filesystems on-the-fly using the Data Accelerator project at Cambridge University, currently #1 in the global IO-500 list. We provide an overview of the technologies involved and an analysis of how its high performance levels are achieved..

0:00:00 Slide 1

0:00:18 Slide 2

0:00:30 Slide 3

0:00:41 Slide 4

0:01:24 Slide 5

0:03:01 Slide 6

0:04:38 Slide 7

0:05:33 Slide 8

0:05:59 Slide 9

0:06:46 Slide 10

The talk

  1. Ad-hoc filesystems for dynamic science workloads 2019-09-17 · 28 min · CERN's player

Credits and licence

Institution
CERN
Department
Ceph Project
Taught by
John Garbutt, Stig Telfer
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed