Learn · CERN

Talk13 min

Seamless integration of commercial Clouds with ATLAS Distributed Computing

Johannes Elmsheuser · CERN

Watch At CERN

About

The CERN ATLAS Experiment successfully uses a worldwide distributed computing Grid infrastructure to support its physics programme at the Large Hadron Collider (LHC). The Grid workflow system PanDA routinely manages up to 700'000 concurrently running production and analysis jobs to process simulation and detector data. In total more than 500 PB of data is distributed over more than 150 sites in the WLCG and handled by the ATLAS data management system Rucio. To prepare for the ever growing data rate in future LHC runs new developments are underway to embrace industry accepted protocols and technologies, and utilize opportunistic resources in a standard way. This paper reviews how the Google and Amazon Cloud computing services have been seamlessly integrated as a Grid site within PanDA and Rucio. Performance and brief cost evaluations will be discussed. Such setups could offer advanced Cloud tool-sets and provide added value for analysis facilities that are under discussions for LHC Run-4..

0:00:00 Slide 1

0:01:17 Slide 2

0:02:34 Slide 3

0:03:51 Slide 4

0:05:08 Slide 5

0:06:25 Slide 6

0:07:41 Slide 7

0:08:58 Slide 8

0:10:15 Slide 9

0:11:32 Slide 10

0:12:49 Slide 11

The talk

  1. Seamless integration of commercial Clouds with ATLAS Distributed Computing 2021-05-20 · 13 min · CERN's player

Credits and licence

Institution
CERN
Department
Conferences
Speaker
Johannes Elmsheuser
Year
2021
Language
English
Subjects
Physics, Computer science, Earth and environment
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed