# Monitoring Evaluation for Large-Scale Environments and Optimizing Data System Health

- Institution: CERN
- Department: CERN openlab Summer Student Programme 2024
- Speaker: Anastasiia Petrovych
- Year: 2024
- Language: English
- Subjects: Medicine and health
- Source: [CERN](https://videos.cern.ch/record/3013650)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

In today's large-scale environments, keeping systems healthy and performing at their best is crucial. This work presents a practical approach to system monitoring that combines various data sources and methods. It explores how service logs and Prometheus metrics provide detailed insights into operational issues and their effects on system performance while also enabling real-time monitoring and alerts via email. The project uses model training techniques to spot problems before affecting system health. Using it, organizations can proactively identify and address anomalies by applying data-driven and unsupervised learning methods, leading to better system performance. We also integrate Kubeflow, an open-source platform for managing machine learning workflows, simplifying the deployment of these models. This combined approach provides a framework for monitoring and optimizing large-scale environments, ensuring data systems remain resilient and effective as operational demands evolve..

0:00:00 Slide 1

0:00:16 Slide 2

0:00:31 Slide 3

0:00:46 Slide 4

0:01:01 Slide 5

0:01:16 Slide 6

0:01:31 Slide 7

0:01:46 Slide 8

0:02:01 Slide 9

0:02:16 Slide 10

0:02:31 Slide 11

0:02:46 Slide 12

0:03:01 Slide 13

0:03:16 Slide 14

0:03:31 Slide 15

0:03:46 Slide 16

0:04:01 Slide 17

0:04:16 Slide 18

0:04:31 Slide 19

0:04:46 Slide 20

0:05:01 Slide 21

0:05:16 Slide 22

0:05:31 Slide 23

0:05:46 Slide 24

0:06:01 Slide 25

0:06:16 Slide 26

0:06:31 Slide 27

0:06:46 Slide 28

0:07:01 Slide 29

0:07:16 Slide 30

## Lectures

1. [Monitoring Evaluation for Large-Scale Environments and Optimizing Data System Health](https://invisiblenetwork.ai/learn/cern/3013650/11512a666010), 8 min (CERN's player)