Learn · CERN

Talk5 min

Evaluation of Erasure Coding & other features of Hadoop 3

Nazerke Seidan · CERN

Watch At CERN

About

Apache Hadoop is a set of 2 domains: data computation such as Spark, MapReduce, Flink, etc and data storage - HDFS. HDFS is a distributed file system. Current HDFS provides 3x replication for data redundancy and availability. But it has 200% storage overhead. However there is a big improvement in Hadoop 3 for replication which is Erasure Coding (EC). Erasure Coding gives the same level of fault tolerance as 3x replication but with much less storage space. My project aims to evaluate the performance of Erasure Coding..

0:00:00 Slide 1

0:00:06 Slide 2

0:00:18 Slide 3

0:00:25 Slide 4

0:00:41 Slide 5

0:00:45 Slide 6

0:01:13 Slide 7

0:02:04 Slide 8

0:02:24 Slide 9

0:02:33 Slide 10

0:02:43 Slide 11

The talk

  1. Evaluation of Erasure Coding & other features of Hadoop 3 2019-08-15 · 5 min · CERN's player

Credits and licence

Institution
CERN
Department
CERN openlab Summer Student programme 2019
Speaker
Nazerke Seidan
Year
2019
Language
English
Source
CERN
Licence
CERN, as CERN states it. CERN's terms
Attribution
© CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
Who can watch
CERN gives no rating. Invisible Network shows it to Teens profiles and older, judged from what the source says about it. How courses are placed