Learn · CERN

Talk15 min

SCION based ScienceDMZ and fast file transfer for HPCCs

Francois Wirz · CERN

Watch At CERN

About

Today's research often relies on a high volume of data. While universities cannot always provide the computing resources to process a given amount of data, a high-performance com- puting cluster (HPCC) offers a cost-effective alternative for re - searchers. With a SCION-based Science DMZ, the HPCC and each univer- sity operate as independent autonomous system (AS), manag- ing their own cryptographic keys and enforcing their own net- work rules. Each AS also has its own LightningFilter deployed. High-volume data transfers between a university and the HPCC are performed using dedicated, SCION-based systems, such as Hercules, which route their traffic through Lightning- Filter instead of the network's general-purpose firewall. With LightningFilter, the ASes can control the amount of traf- fic received from the other ASes or from specific hosts. For instance, the HPCC can enforce different rate limits for each university while guaranteeing a certain throughput for specific hosts. Such limits are important to protect the servic- es offered from misbehaving hosts that consume more band- width than agreed and thus partially or completely block oth- er hosts from reaching the service.

We will present the latest developments on SCION based ScienceDMZ and showcase some early deployments and PoCs..

0:00:00 Slide 1

0:01:08 Slide 2

0:03:29 Slide 3

0:05:44 Slide 4

0:06:53 Slide 5

0:08:05 Slide 6

0:09:24 Slide 7

The talk

  1. SCION based ScienceDMZ and fast file transfer for HPCCs 2024-03-13 · 15 min · CERN's player

Credits and licence

Institution
CERN
Department
HEP Computing
Speaker
Francois Wirz
Year
2024
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed