# Scaling Security Operations Center message processing: from Scala to Go

- Institution: CERN
- Department: IT Lightning Talks (ITLT)
- Speaker: Cristian Schuszter
- Year: 2019
- Language: English
- Subjects: Business and management
- Source: [CERN](https://videos.cern.ch/record/3010639)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

The Security Operations Center of CERN is responsible for ingesting, storing and aggregating an immense amount of data each day (around 2.5TB). The main message processing pipeline used to be based on Spark streaming jobs deployed across a cluster of machines, but was still struggling with the daily load. Nowadays, everything is performed by a single Go binary deployed on 4 machines, with enough resources to spare. This talk focuses on why we switched languages, why it works better, as well as some key implementation takeaways..

0:00:00 Slide 1

0:00:48 Slide 2

0:01:24 Slide 3

0:01:45 Slide 4

0:02:16 Slide 5

0:02:58 Slide 6

0:03:30 Slide 7

0:04:40 Slide 8

## Lectures

1. [Scaling Security Operations Center message processing: from Scala to Go](https://invisiblenetwork.ai/learn/cern/3010639/dd25ddf1b53e), 7 min (CERN's player)