# Python and ROOT: Effective and Interactive Analysis of Big Data

- Institution: CERN
- Department: Developers@CERN Forum
- Speaker: Danilo Piparo
- Year: 2016
- Language: English
- Subjects: Mathematics
- Source: [CERN](https://videos.cern.ch/record/3007412)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

For a long time C++ was virtually the only language of HEP data analysis. This has certainly changed in the past few years: Python became a cornerstone of everyday work of Physicists and this is due to a large extent thanks to ROOT. In this contribution we discuss the technical aspects enabling this innovation.

ROOT is a modular scientific software framework which provides all the functionalities needed to deal with big data processing, statistical analysis, visualisation and storage. One of the reasons for its success is its Python interface, PyROOT. The programming model offered by PyROOT and the way it complements the ROOT C++ one in everyday analysis is characterised. Concrete examples are given of its usage in the software stacks of LHC experiments. The integration of PyROOT with Jupyter notebooks is described as well as glimpses of its potential for interactive data mining of experiments' data and non scientific data such as logs or machine instrumentation output. Elements of R&D activities are also outlined such as the integration of ROOT with Apache Spark with PyROOT and PySpark. The CERN Service for Web based ANalysis, SWAN, is introduced describing its potential for delivering ROOT, Python and other analysis ecosystems.

Live demos are provided whenever possible to grant the audience an enhanced experience..

0:00:00 Slide 1

0:00:08 Slide 2

0:00:39 Slide 3

0:00:45 Slide 4

0:02:03 Slide 5

0:03:31 Slide 6

0:04:36 Slide 7

0:05:02 Slide 8

0:05:14 Slide 9

0:05:57 Slide 10

0:06:03 Slide 11

0:07:12 Slide 12

0:07:39 Slide 13

0:07:48 Slide 14

0:08:37 Slide 15

0:08:44 Slide 16

0:10:02 Slide 17

0:10:19 Slide 18

0:12:18 Slide 19

0:13:03 Slide 20

0:13:52 Slide 21

0:15:08 Slide 22

0:16:12 Slide 23

0:16:43 Slide 24

0:16:51 Slide 25

0:17:19 Slide 26

0:17:35 Slide 27

0:17:49 Slide 28

0:17:58 Slide 29

0:18:32 Slide 30

0:18:55 Slide 31

0:19:16 Slide 32

0:20:39 Slide 33

0:21:10 Slide 34

0:21:15 Slide 35

0:21:22 Slide 36

0:21:37 Slide 37…

## Lectures

1. [Python and ROOT: Effective and Interactive Analysis of Big Data](https://invisiblenetwork.ai/learn/cern/3007412/9dd3c74ef1e6), 32 min (CERN's player)