Learn · CERN

Talk13 min

Performance of CUDA Unified Memory in CMS Heterogeneous Pixel Reconstruction

Ka Hei Martin Kwok · CERN

Watch At CERN

About

The management of separate memory spaces of CPUs and GPUs brings an additional burden to the development of software for GPUs. To help with this, CUDA unified memory provides a single address space that can be accessed from both CPU and GPU. The automatic data transfer mechanism is based on page faults generated by the memory accesses. This mechanism has a performance cost, that can be with explicit memory prefetch requests. Various hints on the inteded usage of the memory regions can also be given to further improve the performance. The overall effect of unified memory compared to an explicit memory management can depend heavily on the application. In this paper we evaluate the performance impact of CUDA unified memory using the heterogeneous pixel reconstruction code from the CMS experiment as a realistic use case of a GPU-targeting HEP reconstruction software. We also compare the programming model using CUDA unified memory to the explicit management of separate CPU and GPU memory spaces..

0:00:00 Slide 1

0:01:14 Slide 2

0:02:27 Slide 3

0:03:40 Slide 4

0:04:54 Slide 5

0:06:07 Slide 6

0:07:20 Slide 7

0:08:34 Slide 8

0:09:47 Slide 9

0:11:00 Slide 10

0:12:14 Slide 11

The talk

  1. Performance of CUDA Unified Memory in CMS Heterogeneous Pixel Reconstruction 2021-05-18 · 13 min · CERN's player

Credits and licence

Institution
CERN
Department
Conferences
Speaker
Ka Hei Martin Kwok
Year
2021
Language
English
Subjects
Physics, Computer science, Earth and environment
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed