Learn · CERN

Talk16 min

Data at scale: from Storage to Data Governance

Jean-Thomas Acquaviva · CERN

Watch At CERN

About

Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata

Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline.

In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution.

The talk

  1. Data at scale: from Storage to Data Governance 2023-03-08 · 16 min · CERN's player

Credits and licence

Institution
CERN
Department
HEP Computing
Speaker
Jean-Thomas Acquaviva
Year
2023
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed