Learn · CERN

Talk11 min

Evaluation of Open Source Large Language Models for Industrial Control

Siria Sadeddin · CERN

Watch At CERN

About

The objective of this project is to identify the most suitable lightweight open-source large language model (LLM) for code summarization in the domain of industrial control systems. The focus is on selecting models that are capable of running on a single GPU with less than 40GB RAM, and provide fast, accurate summaries. The analysis showed promising results, demonstrating the viability of deploying these models in a cost-effective manner for real-world applications. Moreover, fine-tuning efforts, particularly with Llama 3.1 8B, highlighted the potential of these models to deliver context-aware responses..

0:00:00 Slide 1

0:01:24 Slide 2

0:02:59 Slide 3

0:04:17 Slide 4

0:08:51 Slide 5

The talk

  1. Evaluation of Open Source Large Language Models for Industrial Control 2024-08-12 · 11 min · CERN's player

Credits and licence

Institution
CERN
Department
CERN openlab Summer Student Programme 2024
Speaker
Siria Sadeddin
Year
2024
Language
English
Subjects
Languages and linguistics
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed