# Deep Loop Shaping for Angular Sensing and Control in Virgo

- Institution: CERN
- Speaker: Tomislav Andric
- Year: 2026
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3025633)
- Licence: [CERN](https://copyright.web.cern)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Gravitational-wave interferometers rely on hundreds of feedback control loops to stabilize mirror alignment and maintain detector sensitivity. These control systems can inject noise into the observation band, limiting low-frequency performance. Recently, the Deep Loop Shaping (DLS) approach demonstrated that reinforcement learning (RL) can substantially reduce injected control noise in the 10–30 Hz band in the LIGO Livingston Observatory, achieving up to two orders of magnitude suppression on a key alignment loop.

Motivated by these results, we investigate the application of RL-based loop shaping to the Virgo detector. We developed a Virgo-specific Lightsaber time-domain simulation of the DIFFp_TX angular control loop and implemented a distributed RL training pipeline. The environment includes realistic plant dynamics, sensing noise, and stabilization through a baseline linear controller, while the RL agent learns control policies using frequency-domain reward functions designed to suppress control noise while preserving loop stability and taming radiation-pressure effects.

We present the architecture of the training framework, the Virgo Lightsaber model, and results comparing key observables between RL-assisted control and the baseline linear controller. This work represents a crucial step towards the first deployment of reinforcement-learning-based control policies in the Virgo GW detector.

00:00:00 Slide 1

00:00:40 Slide 2

00:02:25 Slide 3

00:02:49 Slide 4

00:03:18 Slide 5

00:03:57 Slide 6

00:05:05 Slide 7

00:05:17 Slide 8

00:05:32 Slide 9

00:05:55 Slide 10

00:06:30 Slide 11

00:06:53 Slide 12

00:07:17 Slide 13

00:07:28 Slide 14

00:07:59 Slide 15

00:08:25 Slide 16

00:09:16 Slide 17

00:09:28 Slide 18

00:10:00 Slide 19

00:10:21 Slide 20

00:11:04 Slide 21

00:11:34 Slide 22

00:12:25 Slide 23

00:12:39 Slide 24

00:12:51 Slide 25

00:13:42 Slide 26

00:14:49 Slide 27

00:15:34 Slide 28

00:16:13 Slide 29

00:16:36 Slide 30

00:17:27 Slide 31…

## Lectures

1. [Deep Loop Shaping for Angular Sensing and Control in Virgo](https://invisiblenetwork.ai/learn/cern/3025633/82136a3a04d5), 28 min (CERN's player)