About
Apache Airflow ([https://airflow.apache.org/][1]) is a key tool we use to orchestrate our data harvesting processes and manage production workflows. This talk will show how Airflow helps us design, schedule, and monitor harvesting pipelines, with concrete examples from daily operations. We will also highlight the main pros and cons we have encountered, including operational and scaling considerations. The session is aimed at engineers and technical users interested in practical workflow orchestration.
[1]: https://airflow.apache.org/
0:00:00 Slide 1
0:03:58 Slide 2
0:04:35 Slide 3
0:06:22 Slide 4
0:06:40 Slide 5
0:07:35 Slide 6
0:08:56 Slide 7
0:19:07 Slide 8
0:21:57 Slide 9
0:25:19 Slide 10
The talk
Credits and licence
- Institution
- CERN
- Speaker
- Joao Ramiro
- Year
- 2026
- Language
- English
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed