About
Apache Hadoop is enabling organizations to collect larger, more varied data - but after it's collected how will it be found? Your users expect to be able to search for information using simple text based queries -- regardless of data location, size, and complexity. How do they quickly find information that's just been created, or been stored for months or even years? Cloudera Search Senior Software Engineer Wolfgang Hoschek will present a solution to this problem; what architecture is necessary to search HDFS and HBase? How was Apache Solr, Lucene, Flume and MapReduce integrated to allow for Near Real Time and Batch indexing of data? What are the solved problems and what's still to come? Join us for an exciting discussion on this new technology.
About the speaker
Wolfgang Hoschek is a Software Engineer at Cloudera working on the Hadoop Platform and Cloudera Search team. He is a committer on the Apache Flume and Apache Lucene/Solr projects, a committer on the Kite project, a committer on the Lily HBase Indexer project, and the lead developer on Morphlines. He is a former CERN fellow and former Computer Scientist at Lawrence Berkeley Laboratory, and former Senior Software Engineer at Skytide. He has 15+ years of experience in large-scale distributed systems, data intensive computing and real time analytics. He received his Ph.D in Computer Science from the Technical University of Vienna, Austria. .
0:00:00 Slide 1
0:03:12 Slide 2
0:07:09 Slide 3
0:10:17 Slide 4
0:14:02 Slide 5
0:23:24 Slide 6
0:24:54 Slide 7
0:28:17 Slide 8
0:32:20 Slide 9
The talk
Credits and licence
- Institution
- CERN
- Department
- Computing Seminar
- Speaker
- Wolfgang Dr. Hoschek
- Year
- 2014
- Language
- English
- Subjects
- Computer science
- Source
- CERN
- Licence
- CERN, as CERN states it. CERN's terms
- Attribution
- © CERN. CERN provides its audiovisual media free of charge for educational and informational use, credited to CERN; this lecture is shown in CERN's own player.
- Who can watch
- CERN gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed