# Big Data Challenges in the Era of Data Deluge (1/2)

- Institution: CERN
- Department: Academic Training Lecture Regular Programme,2014-2015
- Speaker: Ilya Volvovski
- Year: 2015
- Level: Graduate
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3001383)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

For the better or for the worse the amount of data generated in the world grows exponentially. The year of 2012 was dubbed as the year of Big Data and Data Deluge, in 2013 petabyte scale is referenced matter­of­factly and exabyte size is now in the vocabulary of storage providers and large organization. The traditional copy based technology doesn't scale into this size territory, relational DBs give up on many billions rows in tables; typical File Systems are not designed to store trillions of objects. Disks fail, networks are not always available. Yet individuals, businesses and academic institutions demand 100% availability with no data loss. Is this the final dead end? These lectures will describe a storage system, based on IDA (Information Dispersal Algorithm) unlimited in scale, with a very high level of reliability, availability, and unbounded scalable indexing. And all this without any central facility anywhere in the system and thus no single point of failure or any scalability barriers..

0:00:00 Slide 1

0:01:13 Slide 2

0:03:13 Slide 3

0:04:22 Slide 4

0:05:44 Slide 5

0:08:54 Slide 6

0:12:18 Slide 7

0:12:43 Slide 8

0:13:06 Slide 9

0:14:38 Slide 10

0:15:55 Slide 11

0:16:50 Slide 12

0:17:24 Slide 13

0:17:43 Slide 14

0:19:26 Slide 15

0:19:57 Slide 16

0:21:33 Slide 17

0:22:47 Slide 18

0:25:31 Slide 19

0:27:02 Slide 20

0:29:51 Slide 21

0:31:38 Slide 22

0:32:14 Slide 23

0:32:46 Slide 24

0:33:56 Slide 25

0:34:18 Slide 26

0:34:52 Slide 27

0:35:39 Slide 28

0:37:12 Slide 29

0:37:59 Slide 30

0:40:22 Slide 31

0:41:50 Slide 32

0:43:50 Slide 33

0:46:02 Slide 34

0:48:27 Slide 35

0:50:00 Slide 36

0:50:33 Slide 37

0:51:26 Slide 38

0:52:35 Slide 39

0:52:49 Slide 40

0:54:22 Slide 41

0:55:37 Slide 42

0:56:08 Slide 43

0:56:35 Slide 44

0:58:08 Slide 45

0:58:14 Slide 46

0:59:11 Slide 47

0:59:42 Slide 48

1:00:30 Slide 49

1:01:01 Slide 50

1:01:34 Slide 51

1:01:54 Slide 52

1:02:08 Slide 53

1:02:25 Slide 54

1:02:33 Slide 55…

## Lectures

1. [Big Data Challenges in the Era of Data Deluge (1/2)](https://invisiblenetwork.ai/learn/cern/3001383/eef625c64fd5), 1 h 9 min (CERN's player)