Learn · CERN

Talk44 min

INVITED TALK: Better than classical? The subtle art of benchmarking quantum models

Nathan Killoran · CERN

Watch At CERN

About

Abstract: There is no shortage of quantum machine learning papers observing that a particular quantum model "beats its classical counterparts on real-world datasets". However, the subtlety of choices made in benchmark experiments, the small scale of the models and data, as well as narratives influenced by the commercialisation of quantum technologies carry the danger of a strong positivity bias. To judge the true potential of prominent ideas in quantum machine learning we are conducting one of the first large-scale meta-studies that systematically tests 12 popular supervised quantum models at scale using the PennyLane software framework. This talk gives a sneak peek of some surprising preliminary results, and reveals the technical and conceptual difficulty of robust benchmarking, a skill which deserves more attention in the quantum applications literature..

0:00:00 Slide 1

0:01:14 Slide 2

0:02:23 Slide 3

0:03:30 Slide 4

0:06:52 Slide 5

0:08:06 Slide 6

0:11:43 Slide 7

0:13:07 Slide 8

0:14:44 Slide 9

0:16:07 Slide 10

0:17:43 Slide 11

The talk

  1. INVITED TALK: Better than classical? The subtle art of benchmarking quantum models 2023-11-20 · 44 min · CERN's player

Credits and licence

Institution
CERN
Department
QTI other events or meetings
Speaker
Nathan Killoran
Year
2023
Language
English
Subjects
Physics, Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed