# Design of a Resilient, High-Throughput, Persistent Storage System for the ATLAS Phase-II DAQ System

- Institution: CERN
- Department: Conferences
- Speaker: Matias Alejandro Bonaventura
- Year: 2021
- Language: English
- Subjects: Physics, Computer science, Earth and environment
- Source: [CERN](https://videos.cern.ch/record/3007920)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

The ATLAS experiment will undergo a major upgrade to take advan- tage of the new conditions provided by the upgraded High-Luminosity LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprece- dented rates: the detectors will be read out at 1 MHz generating around 5 TB/s of data. The Dataflow system (DF), component of TDAQ, introduces a novel design: readout data are buffered on persistent storage while the event filter- ing system analyses them to select 10000 events per second for a total recorded throughput of around 60 GB/s. This approach allows for decoupling the detector activity from the event selection process. New challenges then arise for DF: de- sign and implement a distributed, reliable, persistent storage system supporting several TB/s of aggregated throughput while providing tens of PB of capacity. In this paper we first describe some of the challenges that DF is facing: data safety with persistent storage limitations, indexing of data at high-granularity in a highly-distributed system, and high-performance management of storage capacity. Then the ongoing R&D to address each of the them is presented and the performance achieved with a working prototype is shown..

0:00:00 Slide 1

0:01:20 Slide 2

0:02:39 Slide 3

0:03:59 Slide 4

0:05:18 Slide 5

0:06:38 Slide 6

0:07:57 Slide 7

0:09:16 Slide 8

0:10:36 Slide 9

0:11:55 Slide 10

0:13:15 Slide 11

## Lectures

1. [Design of a Resilient, High-Throughput, Persistent Storage System for the ATLAS Phase-II DAQ System](https://invisiblenetwork.ai/learn/cern/3007920/baa5ccc83a34), 14 min (CERN's player)