# Adding Search as a first-class citizen to Hadoop

- Institution: CERN
- Department: Computing Seminar
- Speaker: Wolfgang Dr. Hoschek
- Year: 2014
- Language: English
- Subjects: Computer science
- Source: [CERN](https://videos.cern.ch/record/3017299)
- Licence: [CERN](http://copyright.web.cern.ch)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Apache Hadoop is enabling organizations to collect larger, more varied data - but after it's collected how will it be found? Your users expect to be able to search for information using simple text based queries -- regardless of data location, size, and complexity. How do they quickly find information that's just been created, or been stored for months or even years? Cloudera Search Senior Software Engineer Wolfgang Hoschek will present a solution to this problem; what architecture is necessary to search HDFS and HBase? How was Apache Solr, Lucene, Flume and MapReduce integrated to allow for Near Real Time and Batch indexing of data? What are the solved problems and what's still to come? Join us for an exciting discussion on this new technology.

About the speaker

Wolfgang Hoschek is a Software Engineer at Cloudera working on the Hadoop Platform and Cloudera Search team. He is a committer on the Apache Flume and Apache Lucene/Solr projects, a committer on the Kite project, a committer on the Lily HBase Indexer project, and the lead developer on Morphlines. He is a former CERN fellow and former Computer Scientist at Lawrence Berkeley Laboratory, and former Senior Software Engineer at Skytide. He has 15+ years of experience in large-scale distributed systems, data intensive computing and real time analytics. He received his Ph.D in Computer Science from the Technical University of Vienna, Austria. .

0:00:00 Slide 1

0:03:12 Slide 2

0:07:09 Slide 3

0:10:17 Slide 4

0:14:02 Slide 5

0:23:24 Slide 6

0:24:54 Slide 7

0:28:17 Slide 8

0:32:20 Slide 9

0:39:24 Slide 10

0:43:34 Slide 11

0:46:02 Slide 12

0:50:29 Slide 13

0:52:25 Slide 14

0:53:59 Slide 15

0:55:02 Slide 16

0:55:36 Slide 17

0:57:26 Slide 18

0:59:53 Slide 19

1:01:47 Slide 20

1:02:24 Slide 21

1:02:47 Slide 22

## Lectures

1. [Adding Search as a first-class citizen to Hadoop](https://invisiblenetwork.ai/learn/cern/3017299/fe39a3dc2592), 1 h 8 min (CERN's player)