About
The term "Big Data" emphasizes data quantity, not quality. What will be the effective sample size when we take into account the deterioration of data quality because of, for example, the selection bias in COVID-19 testing or the non-response bias in 2016 US Election polling results? This talk provides an answer to such questions, based on the concept of data defect index (ddi) developed in [1]. It will also discuss briefly the application of ddi for 2020 US Election, as reported in [2].
[1] Xiao-Li Meng (2018) "Statistical paradises and paradoxes in big data (I): Law of large populations, big data paradox, and the 2016 US presidential election", Annals of Applied Statistics 12 685.
[2] M. Isakov and S. Kuriwaki (2020) "Towards Principled Unskewing: Viewing 2020 Election Polls Through a Corrective Lens from 2016", Harvard Data Science Review, https://hdsr.mitpress.mit.edu/pub/cnxbwum6/release/3
Xiao-Li Meng is Professor of Statistics at Harvard. He was Chair of their Statistics Department, and is the Founding Editor in Chief of the Harvard Data Science Review. His research interests include 'Statistical theory for data science'; and 'Signal extraction and uncertainty estimates'. He is a very popular lecturer.
EP/IT Data Science Seminar: https://cern.zoom.us/j/98545267593?pwd=akZWdmlyK01zbjFQa0x2c2ZXWW9ydz09.
0:00:00 Slide 1
0:07:34 Slide 2
0:15:07 Slide 3
0:22:40 Slide 4
0:30:13 Slide 5
0:37:46 Slide 6
0:45:19 Slide 7
The talk
Credits and licence
- Institution
- CERN
- Department
- EP-IT Data science seminars
- Speaker
- Xiao-Li Meng
- Year
- 2021
- Language
- English
- Subjects
- Computer science
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed