Learn · CERN

Talk10 min

The one-million table partitions challenge in an ATLAS experiment DB application

Gancho Dimitrov · CERN

Watch At CERN

About

How can a new database system which manages billions of rows with relatively short lifetime (weeks to months) be designed ? The system should resemble a Whiteboard: - data, grouped by given properties form data collections, are added when requested - data collections are consumed by the requestor - when not needed any more, data collections are removed by a "Whiteboard sponge" process.

I will show you what options I explored and which one is potentially the best in terms of efficiency..

0:00:00 Slide 1

0:00:06 Slide 2

0:00:11 Slide 3

0:00:38 Slide 4

0:01:13 Slide 5

0:01:23 Slide 6

0:02:08 Slide 7

0:02:25 Slide 8

0:02:31 Slide 9

0:02:40 Slide 10

The talk

  1. The one-million table partitions challenge in an ATLAS experiment DB application 2019-05-10 · 10 min · CERN's player

Credits and licence

Institution
CERN
Department
IT Lightning Talks (ITLT)
Speaker
Gancho Dimitrov
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed