About
Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and filling histograms. The High Luminosity run of the Large Hadron Collider (HL-LHC), scheduled to start in 2026, will require physicists to regularly skim datasets that are over a PB in size, and repeatedly run over datasets that are 100's of TB's – too big to fit in memory. Declarative programming techniques are a way of separating the intent of the physicist from the mechanics of finding the data, processing the data, and using distributed computing to process it efficiently that is required to extract the plot or data desired in a timely fashion. This paper describes a prototype library that provides a framework for different sub-systems to cooperate in producing this data, using an array-programming declarative interface. This prototype has a servicex data-delivery sub-system and an \awkward array sub-system cooperating to generate requested data. The ServiceX system runs against ATLAS xAOD data..
0:00:00 Slide 1
0:02:07 Slide 2
0:04:14 Slide 3
0:06:21 Slide 4
0:08:28 Slide 5
0:10:35 Slide 6
0:12:41 Slide 7
0:14:48 Slide 8
0:16:55 Slide 9
0:19:02 Slide 10
0:21:09 Slide 11
The talk
Credits and licence
- Institution
- CERN
- Department
- Conferences
- Speaker
- Gordon Watts
- Year
- 2021
- Language
- English
- Subjects
- Physics, Computer science, Earth and environment
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed