Learn · CERN

Talk1 h 8 min

Dealing with BIG Data - Exploiting the Potential of Multicore Parallelism and Auto-Tuning

Victor Pankratius · CERN

Watch At CERN

About

Physics experiments nowadays produce tremendous amounts of data that require sophisticated analyses in order to gain new insights. At such large scale, scientists are facing non-trivial software engineering problems in addition to the physics problems. Ubiquitous multicore processors and GPGPUs have turned almost any computer into a parallel machine and have pushed compute clusters and clouds to become multicore-based and more heterogenous. These developments complicate the exploitation of various types of parallelism within different layers of hardware and software. As a consequence, manual performance tuning is non-intuitive and tedious due to the large search space spanned by numerous inter-related tuning parameters.

This talk addresses these challenges at CERN and discusses how to leverage multicore parallelization techniques in this context. It presents recent advances in automatic performance tuning to algorithmically find sweet spots with good performance. The talk also presents results from empirical studies conducted with different populations of programmers and programming languages to illustrate which approaches worked well.

About the speaker

Victor Pankratius conducts research at MIT in the Computer Science and Artificial Intelligence Laboratory (CSAIL) as a visiting scientist. He is also a Privatdozent at Karlsruhe Institute of Technology where he heads the Multicore Software Engineering investigator group. His research concentrates on how to make parallel programming easier and covers a range of topics including auto-tuning, language design, debugging, software engineering in the cloud, and empirical studies. Victor was also an industry visiting scientist at Intel and Sun Labs/Oracle in the US. He received several awards for his work, including the Intel Leadership Award, for pushing the boundaries at the intersection of software engineering and parallel computing. He serves as the elected chairman of the international Software Engineering for…

The talk

  1. Dealing with BIG Data - Exploiting the Potential of Multicore Parallelism and Auto-Tuning 2012-07-23 · 1 h 8 min · CERN's player

Credits and licence

Institution
CERN
Department
Computing Seminar
Speaker
Victor Pankratius
Year
2012
Language
English
Subjects
Computer science
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed