Containers for Machine Learning in HEP

About

Physicists want to use modern open source machine learning tools developed by industry for machine learning projects and analyses in high energy physics. The software environment that a physicist prototypes, tests, and runs these projects in is ideally the same regardless of compute site (be it their laptop or on the GRID). However, historically it has been difficult to find compute sites that have both the desired hardware resources for machine learning (i.e. GPUs) and a compatible software environment for the project, resulting in suboptimal use of resources and wasted researcher time tuning their software requirements to the imposed constraints. Container technologies, such as [Docker](https://www.docker.com/) and [Singularity](https://www.sylabs.io/singularity/), provide a scalable and robust solution to this problem.

We present work by _Heinrich_ demonstrating the use of containers to run analysis jobs in reproducible compute environments at GRID endpoints with GPU resources that support Singularity. We additionally present complimentary work by _Feickert_ that provides publicly available "base" Docker images of a HEP orientated machine learning environment: the CentOS 7 file system with the ATLAS "standalone" analysis release AnalysisBase, HDF5 support and utilities, and modern Python 3 with pip with libraries such as [NumPy](https://github.com/numpy/numpy), [TensorFlow](https://github.com/tensorflow/tensorflow) and [uproot](https://github.com/scikit-hep/uproot) installed. We further present ongoing synergetic work to expand both these efforts..

0:00:00 Slide 1

0:00:07 Slide 2

0:00:30 Slide 3

0:01:05 Slide 4

0:02:40 Slide 5

0:04:27 Slide 6

0:06:00 Slide 7

0:07:06 Slide 8

0:07:37 Slide 9

0:08:32 Slide 10