Learn · CERN

Talk8 min

Integrating LLM proxy with CERN infrastructure

Nour Guermazi · CERN

Watch At CERN

About

**Project Description**: CERN is consolidating access to its AI resources behind a single gateway: models served on its own GPUs, models bought from commercial providers, and increasingly MCP servers and agents. Placing them on one path allows access to be granted once from CERN identity and group definitions rather than arranged separately for each provider, and makes usage, cost and reliability visible for the organisation as a whole instead of scattered across teams and invoices. This project covers the integration of that gateway, LiteLLM, with the services CERN already runs: a dedicated development instance was deployed, the gateway's Prometheus metrics were onboarded into MONIT and a Grafana dashboard was built over them, and alerting and budget controls were configured.

**Supervisors**: Juan Manuel Guijarro, Ricardo Rocha

00:00:00 Slide 1

00:00:17 Slide 2

00:00:56 Slide 3

00:01:44 Slide 4

00:02:30 Slide 5

00:03:05 Slide 6

00:03:44 Slide 7

00:04:44 Slide 8

00:05:22 Slide 9

00:05:36 Slide 10

The talk

  1. Integrating LLM proxy with CERN infrastructure 2026-08-17 · 8 min · CERN's player

Credits and licence

Institution
CERN
Speaker
Nour Guermazi
Year
2026
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed