Course10610418934 lectures
Big Data Computing
Prof. Rajiv Misra · IIT Patna
About
In today's fast-paced digital world , the incredible amount of data being generated every minute has grown tremendously from sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and GPS signals from cell phone to name a few. This amount of large data with different velocities and varieties is termed as big data and its analytics enables professionals to convert extensive data through statistical and quantitative analysis into powerful insights that can drive efficient decisions. This course provides an in-depth understanding of terminologies and the core concepts behind big data problems, applications, systems and the techniques, that underlie today's big data computing technologies. It provides an introduction to some of the most common frameworks such as Apache Spark, Hadoop, MapReduce, Large scale data storage technologies such as in-memory key/value storage systems, NoSQL distributed databases, Apache Cassandra, HBase and Big Data Streaming Platforms such as Apache Spark Streaming, Apache Kafka Streams that has made big data analysis easier and more accessible. And while discussing the concepts and techniques, we will also look at various applications of Big Data Analytics using Machine Learning, Deep Learning, Graph Processing and many others. The course is suitable for all UG/PG students and practicing engineers/ scientists from the diverse fields and interested in learning about the novel cutting edge techniques and applications of Big Data Computing.
PREREQUISITES : Data Structure & Algorithms, Computer Architecture, Operating System, Database Management Systems
INDUSTRY SUPPORT : Companies like Amazon, Microsoft, Google, IBM, Facebook
Lectures
Week 1
Week 2
- Hadoop Distributed File System (HDFS)
- Hadoop MapReduce 1.0
- Hadoop MapReduce 2.0 (Part-I)
- Hadoop MapReduce 2.0 (Part-II)
- MapReduce Examples
Week 3
- Parallel Programming with Spark
- Introduction to Spark
- Spark Built-in Libraries
- Design of Key-Value Stores
Week 4
- Data Placement Strategies
- CAP Theorem
- Consistency Solutions
- CQL (Cassandra Query Language)
- Design of Zookeeper
Week 5
- Design of HBase
- Spark Streaming and Sliding Window Analytics (Part-I)
- Spark Streaming and Sliding Window Analytics (Part-II)
- Sliding Window Analytics
- Introduction to Kafka
Week 6
- Big Data Machine Learning (Part-I)
- Big Data Machine Learning (Part-II)
- Machine Learning Algorithm K-means using Map Reduce for Big Data Analytics
- Parallel K-means using Map Reduce on Big Data Cluster Analysis
Week 7
- Decision Trees for Big Data Analytics
- Big Data Predictive Analytics (Part-I)
- Big Data Predictive Analytics (Part-II)
Week 8
Syllabus and materials
At NPTEL, as the course publishes them.
Credits and licence
- Institution
- IIT Patna
- Department
- Computer Science and Engineering
- Teacher
- Prof. Rajiv Misra
- Level
- Graduate
- Language
- English
- Subjects
- Computer science, Engineering
- Source
- NPTEL
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge. Coordinated by IIT Kanpur.
- Who can watch
- NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed
More like this
Course
Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
34 lectures · Video
Course
Computational Science and Engineering I
50 lectures · Video