Learn · CERN

Talk14 min

Columnar data analysis with ATLAS analysis formats

Nikolai Hartmann · CERN

Watch At CERN

About

Future analysis of ATLAS data will involve new small-sized analysis formats to cope with the increased storage needs. The smallest of these, named DAOD_PHYSLITE, has calibrations already applied to allow fast downstream analysis and avoid the need for further analysis-specific intermediate formats. This allows for application of the "columnar analysis" paradigm where operations are applied on a per-array instead of a per-event basis. We will present methods to read the data into memory, using Uproot, and also discuss I/O aspects of columnar data and alternatives to the ROOT data format. Furthermore, we will show a representation of the event data model using the Awkward Array package and present proof of concept for a simple analysis application..

0:00:00 Slide 1

0:01:19 Slide 2

0:02:37 Slide 3

0:03:55 Slide 4

0:05:13 Slide 5

0:06:31 Slide 6

0:07:49 Slide 7

0:09:07 Slide 8

0:10:25 Slide 9

0:11:43 Slide 10

0:13:02 Slide 11

The talk

  1. Columnar data analysis with ATLAS analysis formats 2021-05-19 · 14 min · CERN's player

Credits and licence

Institution
CERN
Department
Conferences
Speaker
Nikolai Hartmann
Year
2021
Language
English
Subjects
Physics, Computer science, Earth and environment
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed