Learn · CERN

Talk21 min

Using CVMFS on a distributed Kubernetes cluster - The PRP experience

Igor Sfiligoi · CERN

Watch At CERN

About

The Pacific Research Platform (PRP) is operating a Kubernetes cluster that manages over 2.5k CPU cores and 250 GPUs. The compute nodes are distributed over several locations, mostly in California, all connected with high speed networking of 10Gbps or higher.

In order to support OSG users, we were in need of providing CVMFS support in the Kubernetes cluster. Since user containers run unprivileged, CVMFS could not be used from the user containers themselves. The chosen path forward was to provide CVMFS as a mountable Kubernetes volume. We started with the CERN-provided CSI plugin, but had to make some changes to make it to work in our environment.

In this talk, we will detail the actual setup used, as well as the operational experience of the last 4 months. The perceived missing functionality will also be outlined..

0:00:00 Slide 1

0:00:24 Slide 2

0:00:58 Slide 3

0:01:31 Slide 4

0:02:04 Slide 5

0:03:07 Slide 6

0:03:30 Slide 7

0:04:29 Slide 8

0:05:16 Slide 9

The talk

  1. Using CVMFS on a distributed Kubernetes cluster - The PRP experience 2019-06-03 · 21 min · CERN's player

Credits and licence

Institution
CERN
Department
General
Speaker
Igor Sfiligoi
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed