Learn · CERN

Talk7 min

Scaling Security Operations Center message processing: from Scala to Go

Cristian Schuszter · CERN

Watch At CERN

About

The Security Operations Center of CERN is responsible for ingesting, storing and aggregating an immense amount of data each day (around 2.5TB). The main message processing pipeline used to be based on Spark streaming jobs deployed across a cluster of machines, but was still struggling with the daily load. Nowadays, everything is performed by a single Go binary deployed on 4 machines, with enough resources to spare. This talk focuses on why we switched languages, why it works better, as well as some key implementation takeaways..

0:00:00 Slide 1

0:00:48 Slide 2

0:01:24 Slide 3

0:01:45 Slide 4

0:02:16 Slide 5

0:02:58 Slide 6

0:03:30 Slide 7

0:04:40 Slide 8

The talk

  1. Scaling Security Operations Center message processing: from Scala to Go 2019-05-10 · 7 min · CERN's player

Credits and licence

Institution
CERN
Department
IT Lightning Talks (ITLT)
Speaker
Cristian Schuszter
Year
2019
Language
English
Subjects
Business and management
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed