# CephFS in an HTC cluster and VMs on Ceph RBD with TRIM and differential backups in Bonn

- Institution: CERN
- Department: Ceph Project
- Speaker: Oliver Freyermuth
- Year: 2019
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3002252)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

CephFS is used as the shared file system of the HTC cluster for physicists of various fields in Bonn since beginning of 2018. The cluster uses IP over InfiniBand. High performance for sequential reads is achieved even though erasure coding and on-the-fly compression are employed. CephFS is complemented by a CernVM-FS for software packages and containers which come with many small files. Operational experience with CephFS and exporting it via NFS Ganesha to users' desktop machines, upgrade experiences, and design decisions e.g. concerning the quota setup will be presented.

Additionally, Ceph RBD is used as backend for a libvirt/KVM based virtualisation infrastructure operated by two institutes replicated across multiple buildings. Backups are performed via regular snapshots which allows for differential backups using open-source tools to an external backup storage. Via file system trimming through VirtIO-SCSI and compression of the backups, significant storage is saved. Writeback caching allows to achieve sufficient performance. The system has been tested for resilience in various possible failure scenarios..

0:00:00 Slide 1

0:00:19 Slide 2

0:01:43 Slide 3

0:02:46 Slide 4

0:03:55 Slide 5

0:05:09 Slide 6

0:06:42 Slide 7

0:07:44 Slide 8

0:08:23 Slide 9

0:09:06 Slide 10

0:10:09 Slide 11

0:11:56 Slide 12

0:12:32 Slide 13

0:13:39 Slide 14

0:14:22 Slide 15

0:15:27 Slide 16

0:16:36 Slide 17

0:17:16 Slide 18

0:19:35 Slide 19

## Lectures

1. [CephFS in an HTC cluster and VMs on Ceph RBD with TRIM and differential backups in Bonn](https://invisiblenetwork.ai/learn/cern/3002252/1d618a74a709), 21 min (CERN's player)