Learn · CERN

Talk17 min

CVMFS Build and Release Pipeline Using Docker Microservces

HEATH SKARLUPKA · CERN

Watch At CERN

About

IceCube is a cubic kilometer neutrino detector located at the south pole. CVMFS is a key component to IceCube's Distributed High Throughput Computing analytics workflow for sharing 500GB of software across datacenters worldwide. Building the IceCube software suite across multiple platforms and deploying it into CVMFS has until recently been a manual, time consuming task that doesn't fit well within an agile continuous delivery framework. Within the last 2 years a plethora of tooling around microservices has created an opportunity to upgrade the IceCube software build and deploy pipeline. We present a framework using Kubernetes to deploy Buildbot. The Buildbot pipeline is a set of pods (docker containers) in the Kubernetes cluster that builds the IceCube software across multiple platforms, tests the new software for critical errors, syncs the software to a containerized CVMFS server, and finally executes a publish. The time from code commit to CVMFS publish has been greatly reduced and has enabled the capability of publishing nightly builds to CVMFS..

0:00:00 Slide 1

0:01:48 Slide 2

0:02:30 Slide 3

0:02:57 Slide 4

0:03:06 Slide 5

0:04:21 Slide 6

0:05:31 Slide 7

0:07:30 Slide 8

0:08:17 Slide 9

0:09:07 Slide 10

0:09:57 Slide 11

The talk

  1. CVMFS Build and Release Pipeline Using Docker Microservces 2018-01-31 · 17 min · CERN's player

Credits and licence

Institution
CERN
Department
General
Speaker
HEATH SKARLUPKA
Year
2018
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed