Learn · CERN

Talk24 min

Optimizing High-Dimensional Data Storage: NDMSPC with THnSparse and TTree on EOS

Martin Vala · CERN

Watch At CERN

About

This contribution presents the NDMSPC (N-Dimensional Space) framework, designed for efficient management and analysis of high-dimensional datasets within the CERN EOS environment. We explore the integration of ROOT's THnSparse for memory-efficient multi-dimensional histogramming alongside TTree for robust data storage. By leveraging EOS as the underlying storage layer, the framework achieves the high-throughput I/O necessary for processing exa-scale sparse data. The discussion focuses on optimization techniques for data layout and access patterns that maximize performance when handling complex N-dimensional physics structures in a distributed storage architecture.

00:00:00 Slide 1

00:00:01 Slide 2

00:00:31 Slide 3

00:01:24 Slide 4

00:02:11 Slide 5

00:03:05 Slide 6

00:03:34 Slide 7

00:04:06 Slide 8

00:04:41 Slide 9

00:05:09 Slide 10

00:05:31 Slide 11

The talk

  1. Optimizing High-Dimensional Data Storage: NDMSPC with THnSparse and TTree on EOS 2026-03-11 · 24 min · CERN's player

Credits and licence

Institution
CERN
Speaker
Martin Vala
Year
2026
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed