Learn · CERN

Talk8 min

Focused Forecasts: Attention maps for large-scale model understanding in the AtmoRep project

David Hidary · CERN

Watch At CERN

About

The interpretability of machine learning models remains a critical yet elusive aspect of contemporary computational science. In this presentation, I specifically explore the interpretability of machine learning algorithms by applying self-attention maps to the AtmoRep large-scale weather prediction model. By leveraging self-attention mechanisms, I present a method to analyze the internal structure and dependencies within the model's layers. This technique enables me to interpret the intricate relationships between meteorological variables and the resultant predictions. The application of self-attention maps presents an essential step towards a more transparent and scientifically rigorous approach to interpreting large-scale weather modeling, offering potential implications for advancements in climate science and meteorological forecasting. Relevant buzzwords: AI, ML, HPC, Cloud Computing, Transformer, All You Need, Digital Twin, Computer Vision, Big Data Irrelevant buzzwords: Blockchain, IOT, VR, AR, Quantum Computing, QML, FCC, Exascale, NLP, Beyond the Standard Model.

0:00:00 Slide 1

0:02:45 Slide 2

0:04:53 Slide 3

The talk

  1. Focused Forecasts: Attention maps for large-scale model understanding in the AtmoRep project 2023-08-15 · 8 min · CERN's player

Credits and licence

Institution
CERN
Department
CERN openlab Summer Student Programme 2023
Speaker
David Hidary
Year
2023
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed