# The HPC-Cloud Pipeline: Data Provisioning for Destination Earth and the AI Revolution in Weather Forecasting

- Institution: CERN
- Speaker: Tiago Quintino
- Year: 2026
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3025447)
- Licence: [CERN](https://copyright.web.cern)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

The European Commission's Destination Earth (DestinE) initiative represents a paradigm shift in Earth system simulation, aiming to develop highly accurate digital twins of the Earth. At the core of this endeavour lies the Digital Twin Engine (DTE), an innovative software framework designed to connect the extreme data generation capabilities of High-Performance Computing (HPC) with the interactive, user-centric flexibility of cloud environments.

This keynote discusses the architectural challenges and solutions involved in designing the DTE to enable seamless data provisioning and sharing. A key focus will be the convergence of Numerical Weather Prediction (NWP), Climate Information, and Machine Learning (ML). We will examine how the DTE is evolving to support "AI-ready" datasets, particularly addressing the extensive data handling requirements for ML training, including the upcoming ERA6 reanalysis—the successor to ERA5 and a vital component for future AI model training. Additionally, we will outline the data throughput challenges related to operationalising ECMWF's Artificial Intelligence Forecasting System (AIFS) and explain how we are developing scalable workflows to support the next generation of data-intensive prediction systems.

00:00:00 Slide 1

00:02:37 Slide 2

00:04:05 Slide 3

00:04:25 Slide 4

00:05:00 Slide 5

00:05:20 Slide 6

00:06:00 Slide 7

00:06:35 Slide 8

00:06:52 Slide 9

00:07:44 Slide 10

00:08:25 Slide 11

00:09:09 Slide 12

00:09:54 Slide 13

00:12:54 Slide 14

00:13:54 Slide 15

00:14:18 Slide 16

00:14:54 Slide 17

00:16:04 Slide 18

00:17:38 Slide 19

00:18:03 Slide 20

00:18:48 Slide 21

00:19:52 Slide 22

00:21:27 Slide 23

00:22:26 Slide 24

00:23:14 Slide 25

00:25:21 Slide 26

00:26:20 Slide 27

00:28:23 Slide 28

00:28:45 Slide 29

00:29:31 Slide 30

00:31:21 Slide 31

00:31:53 Slide 32

00:32:27 Slide 33

00:32:58 Slide 34

00:33:34 Slide 35

00:33:53 Slide 36

00:34:32 Slide 37

00:34:43 Slide 38

00:35:05 Slide 39

00:35:39…

## Lectures

1. [The HPC-Cloud Pipeline: Data Provisioning for Destination Earth and the AI Revolution in Weather Forecasting](https://invisiblenetwork.ai/learn/cern/3025447/4c0943828eef), 58 min (CERN's player)