About
Apache Spark is one of the predominant frameworks in the big data space, providing a fully-functional query processing engine, vendor support for hardware accelerators, and performant integrations with scientific computing libraries. One difficulty in adopting conventional big data frameworks to HEP workflows is the lack of support for the ROOT file format in these frameworks. Laurelin implements ROOT I/O with a pure Java library, with no bindings to the C++ ROOT implementation, and is readily installable via standard Java packaging tools. It provides a performant interface enabling Spark to read (and soon write) ROOT TTrees, enabling users to process these data without a pre-processing phase converting to an intermediate format..
0:00:00 Slide 1
0:01:07 Slide 2
0:02:13 Slide 3
0:03:19 Slide 4
0:04:26 Slide 5
0:05:32 Slide 6
0:06:38 Slide 7
0:07:45 Slide 8
0:08:51 Slide 9
0:09:57 Slide 10
0:11:04 Slide 11
The talk
Credits and licence
- Institution
- CERN
- Department
- Conferences
- Speaker
- Andrew Malone Melo
- Year
- 2021
- Language
- English
- Subjects
- Physics, Computer science, Earth and environment
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed