Learn · CERN

Talk13 min

Utilizing RDataFrame for Data Preservation and Open Publishing Data and Analyzes Software for HEP

Pawel Kruczkiewicz · CERN

Watch At CERN

About

CERN produces, analyzes and archives vast amounts of data. To conduct an analysis a lot of software in the form of scripts and code is produced. As the time goes by and new approaches supersede the old ones, the aforementioned artifacts may become hard to understand and setting up and running them can be challenging. This may be a crucial concern when trying to publish the data in an open repository like CERN OpenData. Furthermore, an old code cannot leverage new technological advancements which could potentially enhance its performance. To address this issue an effort to restore data and analysis from LHC Run 1 has been conducted. This work describes the process of transforming data regarding the analysis and code from the LHC Run 1 at the TOTEM experiment. It utilizes RDataFrame – a modern data processing tool – to transcribe C++ scripts into a form of a comprehensible Jupyter notebook. As a result, the number of lines of code has been greatly reduced, thus enhancing the readability. In addition, the notebook can be run on a novel serverless engine architecture. The process described in this work shows potential applicability for further data preservation and publication efforts..

0:00:00 Slide 1

0:01:38 Slide 2

0:02:42 Slide 3

0:10:49 Slide 4

The talk

  1. Utilizing RDataFrame for Data Preservation and Open Publishing Data and Analyzes Software for HEP 2024-03-12 · 13 min · CERN's player

Credits and licence

Institution
CERN
Department
HEP Computing
Speaker
Pawel Kruczkiewicz
Year
2024
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed