# From Text to Threads: Large Language Models and their impact on the HEP community

- Institution: CERN
- Department: Inverted CSC
- Speaker: Andrea Valenzuela Ramirez
- Year: 2024
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3006339)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Over the past year, Large Language Models (LLMs) have demonstrated remarkable capabilities, with ChatGPT rapidly becoming a buzzword on the Internet. These advanced models have been widely applied in various applications and services, recently appearing in scientific domains as well. In the High Energy Physics (HEP) community, GPT models have appeared at one of the key conferences: the latest Conference on Computing in High Energy and Nuclear Physics.

In this lecture, we will examine some foundational components of LLMs, focusing on the well-known GPT models and the techniques to fully leverage their capabilities. We will also review the initial footprints of these technologies within HEP. Starting with the fundamental question: "Can ChatGPT do physics?", we will quickly find that it can already recognize some coding templates from CERN's experiments. Additionally, we will discuss significant drawbacks of these models, such as model hallucinations, which could potentially limit their applicability in rigorous domains.

Finally, we will explore the use of LLMs in coding. We will highlight the challenges of using general LLMs for coding while demonstrating prompt engineering strategies designed to turn natural language generation into code generation and understanding..

0:00:00 Slide 1

0:02:07 Slide 2

0:04:14 Slide 3

0:06:49 Slide 4

0:09:33 Slide 5

0:10:52 Slide 6

0:12:40 Slide 7

0:14:39 Slide 8

0:17:27 Slide 9

0:19:07 Slide 10

0:20:24 Slide 11

0:21:47 Slide 12

0:22:58 Slide 13

0:25:15 Slide 14

0:27:48 Slide 15

0:30:25 Slide 16

0:32:23 Slide 17

0:34:45 Slide 18

0:36:35 Slide 19

0:38:33 Slide 20

0:39:58 Slide 21

0:42:24 Slide 22

0:45:43 Slide 23

0:47:06 Slide 24

## Lectures

1. [From Text to Threads: Large Language Models and their impact on the HEP community](https://invisiblenetwork.ai/learn/cern/3006339/468b42642785), 1 h 1 min (CERN's player)