# Applied Natural Language Processing

- Institution: Chennai Mathematical Institute
- Department: Computer Science and Engineering
- Teacher: Prof. Ramaseshan R
- Level: Undergraduate
- Language: English
- Subjects: Computer science, Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/106106211)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/106106211)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

## Lectures

1. [Introduction](https://invisiblenetwork.ai/learn/nptel/106106211/bfdc986e4781) (Video)
2. [Operations on a Corpus](https://invisiblenetwork.ai/learn/nptel/106106211/1bcf6c622719) (Video)
3. [Probability and NLP](https://invisiblenetwork.ai/learn/nptel/106106211/3f5129b10410) (Video)
4. [Vector Space models](https://invisiblenetwork.ai/learn/nptel/106106211/c35bf44f5c6c) (Video)
5. [Sequence Learning](https://invisiblenetwork.ai/learn/nptel/106106211/f7042672f3d7) (Video)
6. [Machine Translation](https://invisiblenetwork.ai/learn/nptel/106106211/5d061ab78d71) (Video)
7. [Preprocessing](https://invisiblenetwork.ai/learn/nptel/106106211/74ead448a013) (Video)
8. [Statistical Properties of Words - Part 01](https://invisiblenetwork.ai/learn/nptel/106106211/231e417fc74b) (Video)
9. [Statistical Properties of Words - Part 02](https://invisiblenetwork.ai/learn/nptel/106106211/9b30d2e5254c) (Video)
10. [Statistical Properties of Words - Part 03](https://invisiblenetwork.ai/learn/nptel/106106211/96e071a181d2) (Video)
11. [Vector Space Models for NLP](https://invisiblenetwork.ai/learn/nptel/106106211/80958919b983) (Video)
12. [Document Similarity - Demo, Inverted index, Exercise](https://invisiblenetwork.ai/learn/nptel/106106211/78567cec685a) (Video)
13. [Vector Representation of words](https://invisiblenetwork.ai/learn/nptel/106106211/6ed8dcf2bdde) (Video)
14. [Contextual understanding of text](https://invisiblenetwork.ai/learn/nptel/106106211/afc759a70b7d) (Video)
15. [Co-occurence matrix, n-grams](https://invisiblenetwork.ai/learn/nptel/106106211/d9427c625d88) (Video)
16. [Collocations, Dense word Vectors](https://invisiblenetwork.ai/learn/nptel/106106211/2f76e27659cb) (Video)
17. [SVD, Dimensionality reduction, Demo](https://invisiblenetwork.ai/learn/nptel/106106211/a222a3ed889b) (Video)
18. [Query Processing](https://invisiblenetwork.ai/learn/nptel/106106211/4d3446cc484d) (Video)
19. [Topic Modeling](https://invisiblenetwork.ai/learn/nptel/106106211/462cbebe819a) (Video)
20. [Examples for word prediction](https://invisiblenetwork.ai/learn/nptel/106106211/ffc3994680e4) (Video)
21. [Introduction to Probability in the context of NLP](https://invisiblenetwork.ai/learn/nptel/106106211/e72f545d8840) (Video)
22. [Joint and conditional probabilities, independence with examples](https://invisiblenetwork.ai/learn/nptel/106106211/b7f09ea0f2d4) (Video)
23. [The definition of probabilistic language model](https://invisiblenetwork.ai/learn/nptel/106106211/c62ec434bcfc) (Video)
24. [Chain rule and Markov assumption](https://invisiblenetwork.ai/learn/nptel/106106211/4b29b6944b3d) (Video)
25. [Generative Models](https://invisiblenetwork.ai/learn/nptel/106106211/501b6652b209) (Video)
26. [Bigram and Trigram Language models -peeking indide the model building](https://invisiblenetwork.ai/learn/nptel/106106211/1b6ef144c94f) (Video)
27. [Out of vocabulary words and curse of dimensionality](https://invisiblenetwork.ai/learn/nptel/106106211/a5c922a640ea) (Video)
28. [Exercise](https://invisiblenetwork.ai/learn/nptel/106106211/87f8dfc06546) (Video)
29. [Naive-Bayes, classification](https://invisiblenetwork.ai/learn/nptel/106106211/43feb40011a5) (Video)
30. [Machine learning, perceptron, linearly separable](https://invisiblenetwork.ai/learn/nptel/106106211/363b74058480) (Video)
31. [Linear Models for Claassification](https://invisiblenetwork.ai/learn/nptel/106106211/4e2223e528f8) (Video)
32. [Biological Neural Network](https://invisiblenetwork.ai/learn/nptel/106106211/0203830693c8) (Video)
33. [Perceptron](https://invisiblenetwork.ai/learn/nptel/106106211/54d4289a5154) (Video)
34. [Perceptron Learning](https://invisiblenetwork.ai/learn/nptel/106106211/2198c52ac14b) (Video)
35. [Logical XOR](https://invisiblenetwork.ai/learn/nptel/106106211/d25df478fffd) (Video)
36. [Activation Functions](https://invisiblenetwork.ai/learn/nptel/106106211/f15d5a157660) (Video)
37. [Gradient Descent](https://invisiblenetwork.ai/learn/nptel/106106211/5f36546d62c1) (Video)
38. [Feedforward and Backpropagation Neural Network](https://invisiblenetwork.ai/learn/nptel/106106211/490a2416fb62) (Video)
39. [Why Word2Vec?](https://invisiblenetwork.ai/learn/nptel/106106211/10ae7c8d1f26) (Video)
40. [What are CBOW and Skip-Gram Models?](https://invisiblenetwork.ai/learn/nptel/106106211/20f64f1ede2e) (Video)
41. [One word learning architecture](https://invisiblenetwork.ai/learn/nptel/106106211/7a9bd95e5add) (Video)
42. [Forward pass for Word2Vec](https://invisiblenetwork.ai/learn/nptel/106106211/798db18da0e5) (Video)
43. [Matrix Operations Explained](https://invisiblenetwork.ai/learn/nptel/106106211/834b6f38c237) (Video)
44. [CBOW and Skip Gram Models](https://invisiblenetwork.ai/learn/nptel/106106211/450ac502ba15) (Video)
45. [Building Skip-gram model using Python](https://invisiblenetwork.ai/learn/nptel/106106211/001ad8efa064) (Video)
46. [Reduction of complexity - sub-sampling, negative sampling](https://invisiblenetwork.ai/learn/nptel/106106211/e701c4f363e6) (Video)
47. [Binay tree, Hierarchical softmax](https://invisiblenetwork.ai/learn/nptel/106106211/a616b09db4cf) (Video)
48. [Mapping the output layer to Softmax](https://invisiblenetwork.ai/learn/nptel/106106211/b1796cca8e8b) (Video)
49. [Updating the weights using hierarchical softmax](https://invisiblenetwork.ai/learn/nptel/106106211/8ef2b6eb545f) (Video)
50. [Discussion on the results obtained from word2vec](https://invisiblenetwork.ai/learn/nptel/106106211/4544e26cc9e7) (Video)
51. [Recap and Introduction](https://invisiblenetwork.ai/learn/nptel/106106211/e13338afb1ac) (Video)
52. [ANN as a LM and its limitations](https://invisiblenetwork.ai/learn/nptel/106106211/dfecb5a8afb2) (Video)
53. [Sequence Learning and its applications](https://invisiblenetwork.ai/learn/nptel/106106211/994ad6d524c7) (Video)
54. [Introuduction to Recurrent Neural Network](https://invisiblenetwork.ai/learn/nptel/106106211/302f27f2f37d) (Video)
55. [Unrolled RNN](https://invisiblenetwork.ai/learn/nptel/106106211/0d771a4d4bf7) (Video)
56. [RNN - Based Language Model](https://invisiblenetwork.ai/learn/nptel/106106211/b2b584721a71) (Video)
57. [BPTT - Forward Pass](https://invisiblenetwork.ai/learn/nptel/106106211/1ba19d7358bf) (Video)
58. [BPTT - Derivatives for W,V and U](https://invisiblenetwork.ai/learn/nptel/106106211/cc274e8c1275) (Video)
59. [BPTT - Exploding and vanishing gradient](https://invisiblenetwork.ai/learn/nptel/106106211/3b49b5fad9c7) (Video)
60. [LSTM](https://invisiblenetwork.ai/learn/nptel/106106211/e724b8dba0a9) (Video)
61. [Truncated BPTT](https://invisiblenetwork.ai/learn/nptel/106106211/9cb8b9778162) (Video)
62. [GRU](https://invisiblenetwork.ai/learn/nptel/106106211/36f43e2d8388) (Video)
63. [Introduction and Historical Approaches to Machine Translation](https://invisiblenetwork.ai/learn/nptel/106106211/b9bf04c81e57) (Video)
64. [What is SMT?](https://invisiblenetwork.ai/learn/nptel/106106211/191d2bc9efab) (Video)
65. [Noisy Channel Model, Bayes Rule, Language Model](https://invisiblenetwork.ai/learn/nptel/106106211/020c22414ec6) (Video)
66. [Translation Model, Alignment Variables](https://invisiblenetwork.ai/learn/nptel/106106211/76f5f0dd74e7) (Video)
67. [Alignments again!](https://invisiblenetwork.ai/learn/nptel/106106211/026121c5ac88) (Video)
68. [IBM Model 1](https://invisiblenetwork.ai/learn/nptel/106106211/69ce5098755f) (Video)
69. [IBM Model 2](https://invisiblenetwork.ai/learn/nptel/106106211/a58d40ea837a) (Video)
70. [Introduction to Phrase-based translation](https://invisiblenetwork.ai/learn/nptel/106106211/9c42a53cb1dc) (Video)
71. [Symmetrization of alignments](https://invisiblenetwork.ai/learn/nptel/106106211/b88bc98cbe56) (Video)
72. [Extraction of Phrases](https://invisiblenetwork.ai/learn/nptel/106106211/110013d1b22d) (Video)
73. [Learning/estimating the phrase probabilities using another Symmetrization example](https://invisiblenetwork.ai/learn/nptel/106106211/7d4dd5a36a96) (Video)
74. [Introduction to evaluation of Machine Translation](https://invisiblenetwork.ai/learn/nptel/106106211/ad03bdeb78d1) (Video)
75. [BLEU - "A short Discussion of the seminal paper"](https://invisiblenetwork.ai/learn/nptel/106106211/847f8b38f33d) (Video)
76. [BLEU Demo using NLTK and other metrics](https://invisiblenetwork.ai/learn/nptel/106106211/10778f2c717f) (Video)
77. [Encoder-Decoder model for Neural Machine Translation](https://invisiblenetwork.ai/learn/nptel/106106211/8b64a1f51157) (Video)
78. [RNN Based Machine Translation](https://invisiblenetwork.ai/learn/nptel/106106211/41236c9e3fa0) (Video)
79. [Recap and Connecting Bloom Taxonomy with Machine Learning](https://invisiblenetwork.ai/learn/nptel/106106211/74e0a4c4af1c) (Video)
80. [Introduction to Attention based Translation](https://invisiblenetwork.ai/learn/nptel/106106211/1f9a869532c9) (Video)
81. [Research Paper discussion on "Neural machine translation by jointly learning to align and translate"](https://invisiblenetwork.ai/learn/nptel/106106211/de45906f8d5b) (Video)
82. [Typical NMT architecture architecture and models for multi-language translation](https://invisiblenetwork.ai/learn/nptel/106106211/3d659ed6442f) (Video)
83. [Beam Search](https://invisiblenetwork.ai/learn/nptel/106106211/9c88b64f2bc1) (Video)
84. [Variants of Gradient Descend](https://invisiblenetwork.ai/learn/nptel/106106211/0a6bc218efcc) (Video)
85. [Introduction to Conversation Modeling](https://invisiblenetwork.ai/learn/nptel/106106211/9b640d33b479) (Video)
86. [A few examples in Conversation Modeling](https://invisiblenetwork.ai/learn/nptel/106106211/912aadb7cc5d) (Video)
87. [Some ideas to Implement IR-based Conversation Modeling](https://invisiblenetwork.ai/learn/nptel/106106211/0c424ae71651) (Video)
88. [Discussion of some ideas in Question Answering](https://invisiblenetwork.ai/learn/nptel/106106211/30e88c58c9ad) (Video)
89. [Hyperspace Analogue to Language - HAL](https://invisiblenetwork.ai/learn/nptel/106106211/7e07dfea443a) (Video)
90. [Correlated Occurence Analogue to Lexical Semantic - COALS](https://invisiblenetwork.ai/learn/nptel/106106211/07908954e142) (Video)
91. [Global Vectors - Glove](https://invisiblenetwork.ai/learn/nptel/106106211/ee5a9f7afba5) (Video)
92. [Evaluation of Word vectors](https://invisiblenetwork.ai/learn/nptel/106106211/de743ff86d23) (Video)