Learn · CERN

Talk21 min

CephFS in an HTC cluster and VMs on Ceph RBD with TRIM and differential backups in Bonn

Oliver Freyermuth · CERN

Watch At CERN

About

CephFS is used as the shared file system of the HTC cluster for physicists of various fields in Bonn since beginning of 2018. The cluster uses IP over InfiniBand. High performance for sequential reads is achieved even though erasure coding and on-the-fly compression are employed. CephFS is complemented by a CernVM-FS for software packages and containers which come with many small files. Operational experience with CephFS and exporting it via NFS Ganesha to users' desktop machines, upgrade experiences, and design decisions e.g. concerning the quota setup will be presented.

Additionally, Ceph RBD is used as backend for a libvirt/KVM based virtualisation infrastructure operated by two institutes replicated across multiple buildings. Backups are performed via regular snapshots which allows for differential backups using open-source tools to an external backup storage. Via file system trimming through VirtIO-SCSI and compression of the backups, significant storage is saved. Writeback caching allows to achieve sufficient performance. The system has been tested for resilience in various possible failure scenarios..

0:00:00 Slide 1

0:00:19 Slide 2

0:01:43 Slide 3

0:02:46 Slide 4

0:03:55 Slide 5

0:05:09 Slide 6

0:06:42 Slide 7

0:07:44 Slide 8

0:08:23 Slide 9

0:09:06 Slide 10

The talk

  1. CephFS in an HTC cluster and VMs on Ceph RBD with TRIM and differential backups in Bonn 2019-09-17 · 21 min · CERN's player

Credits and licence

Institution
CERN
Department
Ceph Project
Speaker
Oliver Freyermuth
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed