Course10610685271 lectures
Introduction to Information Retrieval
Prof. Dwaipayan Roy · IISER Kolkata
Lectures
Week 1
- Introduction to the course
- Introduction to Information Retrieval
- Text Processing: Term Selection
- Text Processing: Term Filtering and Linguistic Processing
- Indexing
- Inverted Index
Week 2
- Making of the Inverted Index
- Storing Inverted Index
- Inverted Index Summary
- Statistical Properties of Text - Zipf's Law
- Statistical Properties of Text - Heap's Law
- Index Compression
Week 3
- Getting started with PyLucene
- Installing Docker and PyLucene
- Understanding Different Fields in PyLucene - 1
- Understanding Different Fields in PyLucene - 2
- Reading a Small Toy Dataset for Indexing using PyLucene
- Different Analyzers in PyLucene
Week 4
- Indexing using PyLucene - Setting the Parameters
- Indexing using PyLucene - 2
- Non-English Text Analysis using PyLucene
- Exploring Luke: The Lucene Index Viewer
- Experimenting with Different Options in Indexing
- PyLucene Practice Programs - 1
- PyLucene Practice Programs - 2
- Query Processing
Week 5
- Introduction to Ranked Retrieval
- Introduction to Term Weightings for Retrieval - TF
- Introduction to Term Weightings for Retrieval - IDF
- Vector Space Model - 1
- Vector Space Model - 2
- Vector Space Model - 3
Week 6
- Vector Space Model - Problem Solving - 1
- Vector Space Model - Problem Solving - 2
- Probabilistic Model - Introduction
- Binary Independence Model (BIM)
- Best Match Model, BM1, BM11, BM15, BM25
- Dissecting BM25, BM25 vs VSM, BM25 for long queries, BM25F, BM25+
- BM25, After 30 years
Week 7
- Introduction to Language Model for Information Retrieval
- Introducing Unigram Language Model
- Estimating Document Language Model
- Zero Frequency Problem and introduction to Smoothing
- Jelinek-Mercer and Dirichlet Smoothed Language Model
- Comparing Smoothing with IDF and Summary of LM based Retrieval
Week 8
- Using Divergence Measures for Document Scoring
- PyLucene for Retrieval
- PyLucene - Varius Query Classes 1 - TermQuery
- PyLucene - Varius Query Classes 2 - PhraseQuery, TermRangeQuery, Numerical Range Query, PrefixQuery
- PyLucene - Varius Query Classes 3 - BooleanQuery, WildcardQuery, FuzzyQuery, MatchAllDocsQuery
Week 9
- Evaluating Information Retrieval Systems 1 - Set Based Evaluation Metrics
- Evaluating Information Retrieval Systems 2 - Precision@K, R-Prec, Incorporating Ranking in Precision and Recall
- Evaluating Information Retrieval Systems 3 - AP, MAP, GMAP, MRR
- Evaluating Information Retrieval Systems 4 - Graded relevance, nDCG
- Evaluating Information Retrieval Systems 5 - Hypothesis Testing, Role of Evaluation Forums, Kappa measure
Week 10
- Indexing in Benchmark Dataset - Indexing TREC-like Benchmark Datasets
- Retrieval in Benchmark Dataset - Retrieval in TREC-like Benchmark Datasets, and Evaluation using TREC_EVAL
- Comparing Retrieval Models - Hypothesis Testing in Information Retrieval
- Relevance Feedback 1 - An Introduction
- Relevance Feedback 2 - Rocchio's Algorithm
- Relevance Feedback 3 - Incorporating Pseudo Feedback using Relevance based Language Model, RM3
Week 11
- Web Search And Crawler
- PageRank Algorithm
- PageRank - Random Surfer's Algorithm
- HITS Algorithm: Hubs and Authorities
- Search Engine Optimization
Week 12
Syllabus and materials
At NPTEL, as the course publishes them.
Credits and licence
- Institution
- IISER Kolkata
- Department
- Computer Science and Engineering
- Teacher
- Prof. Dwaipayan Roy
- Level
- Undergraduate
- Language
- English
- Subjects
- Computer science, Engineering
- Source
- NPTEL
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge. Coordinated by IIT Madras.
- Who can watch
- NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed
More like this
TED
Talk
The future we're building -- and boring
Source's player
TED
Talk
The thrilling potential of SixthSense technology
Source's player
TED
Talk
Why don't perpetual motion machines ever work?
Source's player
Course
History 7b Spring 2006 UC Berkeley (History 7B US History: from Civil War to Present)
39 lectures · Audio
Course
Science Events Video
84 lectures · Video
Course
Nuclear Engineering 101 001 Fall 2009 UC Berkeley Nuclear Reactions and Radiation (Nuclear Engineering 101, 001|Fall 2009|UC Berkeley (Nuclear Reactions and Radiation))
29 lectures · Audio
Course
Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
34 lectures · Video
Course
Computational Science and Engineering I
50 lectures · Video
Course
Engineering Dynamics
223 lectures · Video
Course
CS50’s Introduction to Computer Science
12 lectures · Video
Course
Frontiers of Biomedical Engineering
25 lectures · Audio
Course
CS50's Introduction to Programming with Python
10 lectures · Video
Course
Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
34 lectures · Video
Course
Computational Science and Engineering I
50 lectures · Video
Course
Engineering Dynamics
223 lectures · Video
Course
CS50’s Introduction to Computer Science
12 lectures · Video
Course
Frontiers of Biomedical Engineering
25 lectures · Audio
Course
CS50's Introduction to Programming with Python
10 lectures · Video