# Generative AI for Computer Vision

- Institution: IIT Guwahati
- Department: Computer Science and Engineering
- Teacher: Prof. Arijit Sur
- Level: Undergraduate
- Language: English
- Subjects: Computer science, Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/106103001)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/106103001)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

This course explores how Generative AI is applied to modern computer vision tasks. Unlike existing NPTEL courses, it specifically emphasized on vision-based generative AI models. It begins with mathematical foundations and classical vision techniques, followed by deep learning architectures. The course then introduces generative learning paradigms including GANs, VAEs, diffusion models, and transformers with a discussion regarding evaluation metrics and training challenges like mode collapse, diffusion noise scheduling, etc. Moreover, it includes LLM models for vision applications like GPT-4V, LLaMA, PaLM-E, Flamingo, etc. This course is primarily focusing on deep generative learning for computer vision tasks like Image Captioning, VQA, Scene Understanding etc. It further discusses multimodal generative models and agentic AI systems for automatic image synthesis and reasoning.

Intended audience: Final/Pre-final year B.Tech/BE, M.Tech/ME, MS, PhD students, Industry professionals, and Faculty members.

Prerequisites: Basics of Machine Learning and Computer Vision. Neural Networks for Vision and NLP.

## Lectures

1. [Introduction](https://invisiblenetwork.ai/learn/nptel/106103001/ef2ff562dbd2) (YouTube)
2. [Generative Modelling](https://invisiblenetwork.ai/learn/nptel/106103001/7b37ca7a65cc) (YouTube)
3. [Generative Vision Models](https://invisiblenetwork.ai/learn/nptel/106103001/5095d0f44387) (YouTube)
4. [Mathematical Preliminaries - I (Linear Algebra)](https://invisiblenetwork.ai/learn/nptel/106103001/77cd37a67937) (YouTube)
5. [Mathematical Preliminaries - II (Basic Probability - I)](https://invisiblenetwork.ai/learn/nptel/106103001/dcc729f8c065) (YouTube)
6. [Mathematical Preliminaries - II (Basic Probability - II)](https://invisiblenetwork.ai/learn/nptel/106103001/0b881d0bbcda) (YouTube)
7. [Mathematical Preliminaries - I (Linear Algebra)](https://invisiblenetwork.ai/learn/nptel/106103001/17b4c95df63f) (YouTube)
8. [Neural Network Fundamentals](https://invisiblenetwork.ai/learn/nptel/106103001/975b70716d1a) (YouTube)
9. [Mathematical Preliminaries - II (Basic Probability - I)](https://invisiblenetwork.ai/learn/nptel/106103001/0e1cb3b8a086) (YouTube)
10. [Neural Network Fundamentals (Multi-Layer Perceptron)](https://invisiblenetwork.ai/learn/nptel/106103001/1ff222f4d7ca) (YouTube)
11. [Mathematical Preliminaries - II (Basic Probability - II)](https://invisiblenetwork.ai/learn/nptel/106103001/5db9e51f327e) (YouTube)
12. [Neural Network Fundamentals (Backpropagation)](https://invisiblenetwork.ai/learn/nptel/106103001/281823a94ef7) (YouTube)
13. [Neural Network Fundamentals (Overfitting)](https://invisiblenetwork.ai/learn/nptel/106103001/147b435f0517) (YouTube)
14. [Convolutional Neural Network - I](https://invisiblenetwork.ai/learn/nptel/106103001/930e2619c769) (YouTube)
15. [Convolutional Neural Network - II](https://invisiblenetwork.ai/learn/nptel/106103001/18f68a38f126) (YouTube)
16. [Convolutional Neural Network - III](https://invisiblenetwork.ai/learn/nptel/106103001/2e2ba71cccca) (YouTube)
17. [CNN with Residual connections - ResNet](https://invisiblenetwork.ai/learn/nptel/106103001/a7ebddaa1284) (YouTube)
18. [CNN Model Architectures - II](https://invisiblenetwork.ai/learn/nptel/106103001/838f9af7d034) (YouTube)
19. [Sequential Modelling](https://invisiblenetwork.ai/learn/nptel/106103001/b361251d1af8) (YouTube)
20. [Training of RNN](https://invisiblenetwork.ai/learn/nptel/106103001/6b8a3e824a79) (YouTube)
21. [LSTM](https://invisiblenetwork.ai/learn/nptel/106103001/dad7b78e69a0) (YouTube)
22. [Sequence Modelling](https://invisiblenetwork.ai/learn/nptel/106103001/ee3a665891c8) (YouTube)
23. [Generative AI for Vision Tasks - I](https://invisiblenetwork.ai/learn/nptel/106103001/5ed1e57b78d3) (YouTube)
24. [Generative AI for Vision Tasks - II](https://invisiblenetwork.ai/learn/nptel/106103001/282c768744a7) (YouTube)
25. [Generative AI](https://invisiblenetwork.ai/learn/nptel/106103001/b09c55a9dfd3) (YouTube)
26. [Auto - Regressive Generative Models](https://invisiblenetwork.ai/learn/nptel/106103001/36cdb223c85b) (YouTube)
27. [Transformers - I](https://invisiblenetwork.ai/learn/nptel/106103001/7e11af5cccbe) (YouTube)
28. [Transformers - II](https://invisiblenetwork.ai/learn/nptel/106103001/c8684f9ee874) (YouTube)
29. [Transformers - III](https://invisiblenetwork.ai/learn/nptel/106103001/68633b7c509a) (YouTube)
30. [Transformers - IV](https://invisiblenetwork.ai/learn/nptel/106103001/8fbb4190bbc7) (YouTube)
31. [Vision Transformers](https://invisiblenetwork.ai/learn/nptel/106103001/2756d454a889) (YouTube)
32. [Variational Auto - Encoder](https://invisiblenetwork.ai/learn/nptel/106103001/9302d813eee6) (YouTube)
33. [Variational Auto - Encoder - II](https://invisiblenetwork.ai/learn/nptel/106103001/399554d52af1) (YouTube)
34. [Diffusion Models - I](https://invisiblenetwork.ai/learn/nptel/106103001/035b79d28cfe) (YouTube)
35. [Diffusion Models - II](https://invisiblenetwork.ai/learn/nptel/106103001/5acd5baa8fc7) (YouTube)
36. [Generative Adversarial Network - I](https://invisiblenetwork.ai/learn/nptel/106103001/90ee73ebd56f) (YouTube)
37. [Generative Adversarial Network - II](https://invisiblenetwork.ai/learn/nptel/106103001/777116de44d2) (YouTube)
38. [Large Language Models - I](https://invisiblenetwork.ai/learn/nptel/106103001/b12be912b631) (YouTube)
39. [Large Language Models - II](https://invisiblenetwork.ai/learn/nptel/106103001/cb3630dd2b22) (YouTube)
40. [Vision Language Models](https://invisiblenetwork.ai/learn/nptel/106103001/9ba0f1af7deb) (YouTube)
41. [Multimodal Generative Models - I](https://invisiblenetwork.ai/learn/nptel/106103001/23891702b329) (YouTube)
42. [Multimodal Generative Models - II](https://invisiblenetwork.ai/learn/nptel/106103001/487fc05b7919) (YouTube)
43. [Multimodal Generative Models - III](https://invisiblenetwork.ai/learn/nptel/106103001/1d1e4464ef2c) (YouTube)
44. [Agentic AI](https://invisiblenetwork.ai/learn/nptel/106103001/2bba48810daf) (YouTube)
45. [Agentic AI - II](https://invisiblenetwork.ai/learn/nptel/106103001/551df6faddfa) (YouTube)
46. [Current Research Trends and Conclusions](https://invisiblenetwork.ai/learn/nptel/106103001/51454efcbfc7) (YouTube)
