# Hadoop Tutorials - Hadoop Foundations

- Institution: CERN
- Department: Workshops
- Taught by: Zbigniew Baranowski, Daniel Lanza Garcia
- Year: 2016
- Language: English
- Source: [CERN](https://videos.cern.ch/record/3001063)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Teens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

The Hadoop ecosystem is the leading opensource platform for distributed storage and processing of "big data". The Hadoop platform is available at CERN as a central service provided by the IT department.

This tutorial organized by the IT Hadoop service, aims to introduce the main concepts about Hadoop technology in a practical way and is targeted to those who would like to start using the service for distributed parallel data processing.

The main topics that will be covered are:

Hadoop architecture and available components

How to perform distributed parallel processing in order to explore and create reports with SQL (with Apache Impala) on example data.

Using a HUE - Hadoop web UI for presenting the results in user friendly way.

How to format and/or structure data in order to make data processing more efficient - by using various data formats/containers and partitioning techniques (Avro, Parquet, HBase). Best practices in this area will be also discussed

Attendees will have the possibility to access a test Hadoop system where they will be able to perform hands-on exercises. Instructions will be provided by the speakers. To facilitate the preparation of the test environment, please register if you plan to attend. .

0:00:00 Slide 1

0:01:21 Slide 2

0:01:42 Slide 3

0:01:56 Slide 4

0:02:55 Slide 5

0:05:32 Slide 6

0:07:04 Slide 7

0:07:24 Slide 8

0:07:55 Slide 9

0:08:23 Slide 10

0:09:15 Slide 11

0:11:51 Slide 12

0:12:41 Slide 13

0:14:48 Slide 14

0:14:58 Slide 15

0:15:17 Slide 16

0:15:40 Slide 17

0:15:52 Slide 18

0:16:03 Slide 19

0:16:09 Slide 20

0:16:58 Slide 21

0:18:21 Slide 22

0:20:05 Slide 23

0:20:51 Slide 24

0:22:38 Slide 25

0:23:48 Slide 26

0:24:06 Slide 27

0:25:42 Slide 28

0:29:43 Slide 29

0:29:57 Slide 30

0:30:05 Slide 31

0:30:09 Slide 32

0:30:16 Slide 33

0:30:51 Slide 34

0:30:59 Slide 35

0:31:04 Slide 36

0:31:39 Slide 37

0:31:51 Slide 38

0:31:55 Slide 39

0:31:59 Slide 40

0:32:17 Slide 41

0:32:39 Slide 42

0:32:56…

## Lectures

1. [Hadoop Tutorials - Hadoop Foundations](https://invisiblenetwork.ai/learn/cern/3001063/0f880747cde0), 1 h 54 min (CERN's player)
