Learn · CERN

Talk1 h 39 min

Real-Time processing of Big Data with ScyllaDB

Glauber Costa and Miguel Martinez Pedreira · CERN

Watch At CERN

About

ScyllaDB: achieving 1 million operations/sec with stable and consistent real time latencies

This talk will present ScyllaDB, a highly available Real-time Big Data Database that can achieve high throughput without compromising latencies or availability. ScyllaDB is API-compatible with Apache Cassandra but employs a different internal architecture to make sure that operational capacity is increased while the maintenance burden is reduced. It provides everything that a new-world database must provide: horizontal (infinite) scaling, no single point of failure, high availability and excellent performance, while keeping a sensible amount of operational efforts. Some of the key points that make ScyllaDB very efficient are its fully asynchronous operations and the smart integration with the kernel and hardware. You will learn about what makes ScyllaDB special in the crowded space of NoSQL solutions and how it can be used to power a wide variety of workloads: from real time bidding to the experiment data from the ALICE Collaboration.

About the speakers

Glauber Costa (Lord Glauber I of Sealand) is a Principal Architect at ScyllaDB. He shares his time between the engineering department working on upcoming Scylla features and helping customers succeed. Before ScyllaDB, Glauber worked with Virtualization in the Linux Kernel for 10 years, with contributions ranging from the Xen Hypervisor to all sorts of guest functionality and containers.

Miguel Martinez Pedreira is a core developer in the ALICE Offline team at CERN, working on the GRID middleware called AliEn and involved in the operation and maintenance of its multiple backends. The main one is the File Catalogue, that holds all the ALICE experiment data, and Miguel is facing its redesign in order to be ready for LHC Run3 scalability challenges. .

0:00:00 Slide 1

0:05:15 Slide 2

0:05:33 Slide 3

0:09:39 Slide 4

0:12:37 Slide 5

0:13:46 Slide 6

0:15:58 Slide 7

The talk

  1. Real-Time processing of Big Data with ScyllaDB 2018-06-29 · 1 h 39 min · CERN's player

Credits and licence

Institution
CERN
Department
CERN Computing Seminar
Taught by
Glauber Costa, Miguel Martinez Pedreira
Year
2018
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed