Learn · CERN

Talk31 min

Persistent Memory based Key-Value Store for Data Acquisition Systems

Maciej Maciejewski · CERN

Watch At CERN

About

Data acquisition (DAQ) systems are a key component for successful data taking in any experiment. The DAQ is a complex distributed computing system and coordinates all operations, from the data selection stage to long-term storage. With increasing throughput demand, new ways to handle distributed data are being explored. One of the approaches is to use specialized Key-Value store, that would be able to handle data rates bound to network interfaces only (100-400 Gbps), while providing usage flexibility with specialized APIs designed for DAQ. We shall present how combining new storage technologies based on Intel Optane DC Persistent Memory and NVMe drives, with specialized design of Key-Value store can help achieve throughput goals, and provide operational flexibility and safety..

0:00:00 Slide 1

0:00:19 Slide 2

0:00:55 Slide 3

0:00:59 Slide 4

0:02:11 Slide 5

0:02:32 Slide 6

0:05:15 Slide 7

0:06:46 Slide 8

0:06:51 Slide 9

0:09:38 Slide 10

0:11:54 Slide 11

The talk

  1. Persistent Memory based Key-Value Store for Data Acquisition Systems 2019-09-25 · 31 min · CERN's player

Credits and licence

Institution
CERN
Department
other events or meetings
Speaker
Maciej Maciejewski
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed