# Foundations of Deep Learning: Concepts and Applications

- Institution: IISc Bangalore RV University
- Department: Computer Science and Engineering
- Teacher: Prof. Sriram Ganapathy Prof. Ashwini Kodipalli Prof. Baishali Garai
- Level: Undergraduate
- Language: English
- Subjects: Computer science, Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/106108840)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/106108840)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

## Lectures

1. [Overview of Machine Learning and Deep Learning](https://invisiblenetwork.ai/learn/nptel/106108840/a1997d6e83ab) (Video)
2. [Single Layer Perceptron](https://invisiblenetwork.ai/learn/nptel/106108840/4a9fee3ae338) (Video)
3. [Hands-on on Single Layer Perceptron](https://invisiblenetwork.ai/learn/nptel/106108840/07ddc332a402) (Video)
4. [Multi-Layer Perceptron](https://invisiblenetwork.ai/learn/nptel/106108840/48904dee4e44) (Video)
5. [Activation and Loss Functions](https://invisiblenetwork.ai/learn/nptel/106108840/5149d1be34cb) (Video)
6. [Gradient descent algorithm](https://invisiblenetwork.ai/learn/nptel/106108840/909aa4667c83) (Video)
7. [Backpropagation in Neural Network](https://invisiblenetwork.ai/learn/nptel/106108840/c85c827904f2) (Video)
8. [Varients of Gradient descent and Momentum based techniques](https://invisiblenetwork.ai/learn/nptel/106108840/c10bc09e0b82) (Video)
9. [Regularization techniques in Neural Networks](https://invisiblenetwork.ai/learn/nptel/106108840/07998426da10) (Video)
10. [Hands-on on MLP for classification problem](https://invisiblenetwork.ai/learn/nptel/106108840/323e88115b16) (Video)
11. [Fundamentals of Image representation and Image preprocessing and Data augmentation](https://invisiblenetwork.ai/learn/nptel/106108840/f919133ec3d7) (Video)
12. [Introduction to Convolutional Neural Networks, Inspiration behind CNN, Key Components of CNN](https://invisiblenetwork.ai/learn/nptel/106108840/66e3181c1284) (Video)
13. [Convolution for RGB, Pooling Layer and Flatten Layer](https://invisiblenetwork.ai/learn/nptel/106108840/39f808708c1b) (Video)
14. [Batch Normalization](https://invisiblenetwork.ai/learn/nptel/106108840/34d810083cc0) (Video)
15. [Hands-on session on building simple CNN model](https://invisiblenetwork.ai/learn/nptel/106108840/27eb767a416c) (Video)
16. [Architecture and Implementation of AlexNet](https://invisiblenetwork.ai/learn/nptel/106108840/8776f69d5865) (Video)
17. [VGGNet (VGG16 and VGG19) and GoogleNet](https://invisiblenetwork.ai/learn/nptel/106108840/1f93939fedf7) (Video)
18. [Introduction to ResNet (ResNet 34 and ResNet50)](https://invisiblenetwork.ai/learn/nptel/106108840/308b115a7e16) (Video)
19. [Introduction to Transfer Learning](https://invisiblenetwork.ai/learn/nptel/106108840/0f17faefc884) (Video)
20. [Hands-on on standard CNN architectures and transfer learning](https://invisiblenetwork.ai/learn/nptel/106108840/52af576f5483) (Video)
21. [Hands-on on building and deep CNN ensemble model.](https://invisiblenetwork.ai/learn/nptel/106108840/3b0b1ecfc763) (Video)
22. [Need for XAI, PCI, Occlusion method](https://invisiblenetwork.ai/learn/nptel/106108840/8710d1f59847) (Video)
23. [SHAP and LIME](https://invisiblenetwork.ai/learn/nptel/106108840/3d73dc35937e) (Video)
24. [Guided backpropagation](https://invisiblenetwork.ai/learn/nptel/106108840/b0758fd3b14a) (Video)
25. [Grad-CAM and Class Activation Maps (CAMs)](https://invisiblenetwork.ai/learn/nptel/106108840/5b7051ad445b) (Video)
26. [Hands-on implemenation of XAI methods](https://invisiblenetwork.ai/learn/nptel/106108840/d1d5ab38bf13) (Video)
27. [Image segmentation](https://invisiblenetwork.ai/learn/nptel/106108840/9eaee104f978) (Video)
28. [U-Net with Attention and Evaluation Metric for Segmentation](https://invisiblenetwork.ai/learn/nptel/106108840/a9f76cfa0614) (Video)
29. [Object detection](https://invisiblenetwork.ai/learn/nptel/106108840/b83fd32421c4) (Video)
30. [YOLO v1 for object detection](https://invisiblenetwork.ai/learn/nptel/106108840/f8dc5fd42ab4) (Video)
31. [Hands-on implemenation of Unet](https://invisiblenetwork.ai/learn/nptel/106108840/3b01c986f4a6) (Video)
32. [Creating .yaml file for the custom dataset](https://invisiblenetwork.ai/learn/nptel/106108840/d89616441c3a) (Video)
33. [Hands-on implemenation of YOLO](https://invisiblenetwork.ai/learn/nptel/106108840/282a1589aeb3) (Video)
34. [Introduction to Recurrent Neural Networks](https://invisiblenetwork.ai/learn/nptel/106108840/cbdbc2bc19f6) (Video)
35. [Numerical Example for RNN](https://invisiblenetwork.ai/learn/nptel/106108840/4bf0dd12105b) (Video)
36. [Vanishing and exploding gradients in NN](https://invisiblenetwork.ai/learn/nptel/106108840/26e3f66b93cd) (Video)
37. [Backpropagation through time (BTT)](https://invisiblenetwork.ai/learn/nptel/106108840/07c19c5a31d3) (Video)
38. [Hands-on implementation of RNN model and its variants.](https://invisiblenetwork.ai/learn/nptel/106108840/30a4ea777bad) (Video)
39. [Introduction to LSTM](https://invisiblenetwork.ai/learn/nptel/106108840/a1d9a5b5e191) (Video)
40. [Gated Recurrent Unit](https://invisiblenetwork.ai/learn/nptel/106108840/f30405e4c410) (Video)
41. [LSTM-Encoder Decoder Structure](https://invisiblenetwork.ai/learn/nptel/106108840/39c63fbb8c44) (Video)
42. [LSTM with attention](https://invisiblenetwork.ai/learn/nptel/106108840/49470079c323) (Video)
43. [Hands-on implementation of LSTM](https://invisiblenetwork.ai/learn/nptel/106108840/b09d05519593) (Video)
44. [Introduction to NLP](https://invisiblenetwork.ai/learn/nptel/106108840/46270a950020) (Video)
45. [Text Preprocessing and Text Representations](https://invisiblenetwork.ai/learn/nptel/106108840/5922566a75ad) (Video)
46. [Discrete and Distributed Word Representation](https://invisiblenetwork.ai/learn/nptel/106108840/39196a29b620) (Video)
47. [Word Embeddings in NLP](https://invisiblenetwork.ai/learn/nptel/106108840/7f0ea4d861c3) (Video)
48. [Hands-on implementation of RNN in NLP application](https://invisiblenetwork.ai/learn/nptel/106108840/25881e0203d5) (Video)
49. [Introduction to Autoencoders](https://invisiblenetwork.ai/learn/nptel/106108840/01ea2d3a10a1) (Video)
50. [Types of Autoencoders](https://invisiblenetwork.ai/learn/nptel/106108840/e9092b7634d4) (Video)
51. [VAE Architecture - Encoder part](https://invisiblenetwork.ai/learn/nptel/106108840/02173110c885) (Video)
52. [VAE Architecture - Decoder part](https://invisiblenetwork.ai/learn/nptel/106108840/7c89aa50b4fa) (Video)
53. [Reparameterization Trick](https://invisiblenetwork.ai/learn/nptel/106108840/5574abfedfc8) (Video)
54. [Hands-on implemenation of Autoencoders](https://invisiblenetwork.ai/learn/nptel/106108840/27943e4bfea2) (Video)
55. [Foundations of Language Modeling and Transformers](https://invisiblenetwork.ai/learn/nptel/106108840/dffebd3da70a) (Video)
56. [Transformer Architectures and Attention Mechanisms](https://invisiblenetwork.ai/learn/nptel/106108840/3b5732c938c2) (Video)
57. [In-context learning and Self-Supervised Learning in LLMs](https://invisiblenetwork.ai/learn/nptel/106108840/ba68cf5a519d) (Video)
58. [Large Language Models: Tokenization, Generation, and Sampling](https://invisiblenetwork.ai/learn/nptel/106108840/8bd5f30f45fd) (Video)
59. [Pre-training and Instruction Tuning of Large Language Models](https://invisiblenetwork.ai/learn/nptel/106108840/be29fac806a3) (Video)
60. [Reinforcement Learning for Aligning Large Language Models](https://invisiblenetwork.ai/learn/nptel/106108840/03277f80e757) (Video)
61. [Reasoning, Retrieval, and Efficiency in Post-trained LLMs](https://invisiblenetwork.ai/learn/nptel/106108840/d005a4d5388b) (Video)
62. [Evaluation, Benchmarking, and Impact of Foundation Models](https://invisiblenetwork.ai/learn/nptel/106108840/2837281e69fa) (Video)
63. [LLMs demo -TA](https://invisiblenetwork.ai/learn/nptel/106108840/6e08cc6153b7) (Video)
64. [Diffusion Models for Generative Modelling](https://invisiblenetwork.ai/learn/nptel/106108840/d538096368a7) (Video)
65. [GANs and Diffusion models demo -TA](https://invisiblenetwork.ai/learn/nptel/106108840/7ac79f7c37b5) (Video)