Learn · CERN

Talk24 min

Backing up CERNBox: Lessons learned.

Joao Calado Vicente and Roberto Valverde Cameselle · CERN

Watch At CERN

About

CERNBox is the cloud sync and share service implementation at CERN which is used by physicists and collaborators across the globe. Data stored in CERNBox is becoming more and more critical and having a backup system is crucial for its preservation.

Two years ago we started a prototype of a backup orchestrator based on the open source tool restic. In 2020 the project reached its maturity and was enabled as the main production system for backup and restore. At the time being, more than 3PB of backup data is stored in S3 and more than 36K backup jobs are scheduled every day over the eosxd mounts.

In this presentation, we will give an overview of the project focusing on challenges, what we have learnt and talk about future plans..

0:00:00 Slide 1

0:02:24 Slide 2

0:04:47 Slide 3

0:07:10 Slide 4

0:09:33 Slide 5

0:11:57 Slide 6

0:14:20 Slide 7

0:16:43 Slide 8

0:19:06 Slide 9

The talk

  1. Backing up CERNBox: Lessons learned. 2021-03-03 · 24 min · CERN's player

Credits and licence

Institution
CERN
Department
HEP Computing
Taught by
Joao Calado Vicente, Roberto Valverde Cameselle
Year
2021
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed