# Integrating LLM proxy with CERN infrastructure

- Institution: CERN
- Speaker: Nour Guermazi
- Year: 2026
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3026674)
- Licence: [CERN](https://copyright.web.cern)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

**Project Description**: CERN is consolidating access to its AI resources behind a single gateway: models served on its own GPUs, models bought from commercial providers, and increasingly MCP servers and agents. Placing them on one path allows access to be granted once from CERN identity and group definitions rather than arranged separately for each provider, and makes usage, cost and reliability visible for the organisation as a whole instead of scattered across teams and invoices. This project covers the integration of that gateway, LiteLLM, with the services CERN already runs: a dedicated development instance was deployed, the gateway's Prometheus metrics were onboarded into MONIT and a Grafana dashboard was built over them, and alerting and budget controls were configured.

**Supervisors**: Juan Manuel Guijarro, Ricardo Rocha

00:00:00 Slide 1

00:00:17 Slide 2

00:00:56 Slide 3

00:01:44 Slide 4

00:02:30 Slide 5

00:03:05 Slide 6

00:03:44 Slide 7

00:04:44 Slide 8

00:05:22 Slide 9

00:05:36 Slide 10

00:06:20 Slide 11

## Lectures

1. [Integrating LLM proxy with CERN infrastructure](https://invisiblenetwork.ai/learn/cern/3026674/4ff80bde7f6b), 8 min (CERN's player)