Automated calibration at Belle II

About

The Belle II detector began collecting data from $e^+e^-$ collisions at the SuperKEKB electron-positron collider in March 2019 and has already exceeded the Belle instantaneous luminosity. The result is an unprecedented amount of incoming raw data that must be calibrated promptly prior to data reconstruction. To fully automate the calibration process a Python plugin package, b2cal, had been developed based on the open-source Apache Airflow package using Directed Acyclic Graphs (DAGs) to describe the ordering of processes and Flask to provide administration and job submission web pages. This system was used in 2019 to help automate calibrations at the KEK Computing Center and has been upgraded to be capable of running at multiple calibration centers with successful operations at Brookhaven National Laboratory (BNL) and Deutsches Elektronen-Synchrotron Laboratory (DESY). The webserver hosting b2cal has been migrated from Melbourne to DESY where authentication using the internal DESY LDAP server has been added. DAGs have been updated to further automate the calibration as the job submission and validation of payloads occurs as soon as possible and without human intervention. The application has been dockerised so that it can be efficiently deployed on any machine..

0:00:00 Slide 1

0:01:03 Slide 2

0:02:06 Slide 3

0:03:08 Slide 4

0:04:11 Slide 5

0:05:13 Slide 6

0:06:16 Slide 7

0:07:18 Slide 8

0:08:21 Slide 9

0:09:23 Slide 10

0:10:26 Slide 11