# Applied Accelerated Artificial Intelligence

- Institution: IIT Guwahati KLE Technological University
- Department: Computer Science and Engineering
- Taught by: Prof. Satyajit Das, Prof. Satyadhyan Chickerur
- Level: Graduate
- Language: English
- Subjects: Computer science, Engineering
- Source: [NPTEL](https://nptel.ac.in/courses/106106238)
- Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.)
- Syllabus: [at the source](https://nptel.ac.in/courses/106106238)
- Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words)

Technical Partners

ABOUT THE COURSE: This course will cover the fundamentals of the compute capabilities and the system software required for implementing artificial intelligence (AI) based solutions with accelerated computing on industrial use cases such as the one in the domains of Smart City. The course will discuss end to end deployments of industrial use cases like using large language models with demonstration, and hence will help participants use state-of-the-art AI SDKs effectively to solve complex problems.

The content was originally developed for a course organized by the NSM Nodal Centers at IIT Goa, IIT Kharagpur, IIT Madras, and IIT Palakkad. (Link: https://iitgoa.ac.in/aishikshaai/)

Intended audience: Ph.D Scholars (any stream of Science or Engineering); Post Graduate Students (any stream of Science or Engineering); 3rd and 4th year UG Students (any stream of Engineering); Non-Students and Working Professionals

Prerequisites: Prior knowledge of Computer Organization, High-Performance; Computing, Machine Learning and Deep learning is desirable

## Lectures

1. [Lecture 1: CPU Architecture](https://invisiblenetwork.ai/learn/nptel/106106238/08f8e998da14) (YouTube)
2. [Lecture 2 : Memory Hierarchy](https://invisiblenetwork.ai/learn/nptel/106106238/e5ac3f2c8529) (YouTube)
3. [Lecture 3 : GPU Fundamentals & Modern](https://invisiblenetwork.ai/learn/nptel/106106238/31d61e212a16) (YouTube)
4. [Lecture 4: Interconnects - PCIe, NVLink and NVSwitch](https://invisiblenetwork.ai/learn/nptel/106106238/f602a953bb39) (YouTube)
5. [Lecture 5 : AI Software stack - OS, Drivers and Runtime Layers](https://invisiblenetwork.ai/learn/nptel/106106238/ececb6670cc6) (YouTube)
6. [Lecture 1 : Docker fundamentals for GPU - enabled AI workloads](https://invisiblenetwork.ai/learn/nptel/106106238/d9a9789c0598) (YouTube)
7. [Lecture 2 : Deterministic Environment & Containerized Jupyter](https://invisiblenetwork.ai/learn/nptel/106106238/85746c3a27ac) (YouTube)
8. [Lecture 3 : CUDA in Containers & CI Validation](https://invisiblenetwork.ai/learn/nptel/106106238/80590aa311fb) (YouTube)
9. [Lecture 4 : Schedulers & GPU Allocation in Multi-User Environments](https://invisiblenetwork.ai/learn/nptel/106106238/3eb232840b6c) (YouTube)
10. [Lecture 1 : Kubernetes Fundamentals for AI Workloads](https://invisiblenetwork.ai/learn/nptel/106106238/ecbeb4fd47ce) (YouTube)
11. [Lecture 2 : GPU Pod Scheduling,Node Selector, Tolerations](https://invisiblenetwork.ai/learn/nptel/106106238/3523e5b187af) (YouTube)
12. [Lectrue 3 : K8s Networking & Configuration for AI Workloads](https://invisiblenetwork.ai/learn/nptel/106106238/a885546bb958) (YouTube)
13. [Lecture 4 : ConfigMaps, Secrets & Config Injection](https://invisiblenetwork.ai/learn/nptel/106106238/762063a48dc4) (YouTube)
14. [Lecture 1 : Tensors & Autograd](https://invisiblenetwork.ai/learn/nptel/106106238/5239fc2e25ac) (YouTube)
15. [Lecture 2 : Building Models with nn.Module](https://invisiblenetwork.ai/learn/nptel/106106238/847383674795) (YouTube)
16. [Lecture 3 : The Training Loop](https://invisiblenetwork.ai/learn/nptel/106106238/a4a74420c0ec) (YouTube)
17. [Lecture 4 : Data loaded & Feeding the model efficiently](https://invisiblenetwork.ai/learn/nptel/106106238/6f8f88cde97d) (YouTube)
18. [Lecture 5 : First steps in performance](https://invisiblenetwork.ai/learn/nptel/106106238/e58da66d255f) (YouTube)
19. [Lecture 1 : TensorFlow Execution Models & Performance Basics](https://invisiblenetwork.ai/learn/nptel/106106238/211b0a5a2998) (YouTube)
20. [Lecture 2 : Optimization Input Pipelines with tf.data](https://invisiblenetwork.ai/learn/nptel/106106238/b608ba9df2a3) (YouTube)
21. [Lecture 3 : Graph Execution & TensorFlow Optimization](https://invisiblenetwork.ai/learn/nptel/106106238/6139a5e5c542) (YouTube)
22. [Lecture 4 : Introduction to XLA Compilation](https://invisiblenetwork.ai/learn/nptel/106106238/7b92f3a67d67) (YouTube)
23. [Lecture 5 : Model Interoperability: SavedModel vs ONNX](https://invisiblenetwork.ai/learn/nptel/106106238/02e62b2d2045) (YouTube)
24. [Lecture 1 : LLM Foundation and terminology](https://invisiblenetwork.ai/learn/nptel/106106238/ed9b4bc10352) (YouTube)
25. [Lecture 2 : Mixed precision and numerical stability](https://invisiblenetwork.ai/learn/nptel/106106238/d5c732092bde) (YouTube)
26. [Lecture 3 : Memory Optimization and throughput](https://invisiblenetwork.ai/learn/nptel/106106238/d0e2a85306f2) (YouTube)
27. [Lecture 4 : Transfer learning for large models](https://invisiblenetwork.ai/learn/nptel/106106238/c5e4633a61c7) (YouTube)
28. [lecture 5 : Efficient LLM fine-tuning using PEFT AND LoRA](https://invisiblenetwork.ai/learn/nptel/106106238/1846d3eaf312) (YouTube)
29. [Fundamentals of Distributed AI Computing Session 1 Part 1](https://invisiblenetwork.ai/learn/nptel/106106238/aa37d0272733) (YouTube)
30. [Fundamentals of Distributed AI Computing Session 1 Part 2](https://invisiblenetwork.ai/learn/nptel/106106238/ee668e5ab53f) (YouTube)
31. [Fundamentals of Distributed AI Computing Session 2 Part 1](https://invisiblenetwork.ai/learn/nptel/106106238/93463c705c61) (YouTube)
32. [Fundamentals of Distributed AI Computing Session 2 Part 2](https://invisiblenetwork.ai/learn/nptel/106106238/8bbd9c4549ed) (YouTube)
33. [Distributed Deep Learning using Tensorflow and Horovod](https://invisiblenetwork.ai/learn/nptel/106106238/d6367b04b581) (YouTube)
34. [Challenges with Distributed Deep Learning Training Convergence](https://invisiblenetwork.ai/learn/nptel/106106238/49be7cf3c607) (YouTube)
35. [Fundamentals of Accelerating Deployment part 1](https://invisiblenetwork.ai/learn/nptel/106106238/4515375d198b) (YouTube)
36. [Fundamentals of Accelerating Deployment part 2](https://invisiblenetwork.ai/learn/nptel/106106238/01a575287dd8) (YouTube)
37. [Accelerating neural network inference in PyTorch and TensorFlow part 1](https://invisiblenetwork.ai/learn/nptel/106106238/bf8a8b7abec1) (YouTube)
38. [Accelerating neural network inference in PyTorch and TensorFlow part 2](https://invisiblenetwork.ai/learn/nptel/106106238/0137d01d35e0) (YouTube)
39. [Accelerated Data Analytics part 1](https://invisiblenetwork.ai/learn/nptel/106106238/46dadcee4092) (YouTube)
40. [Accelerated Data Analytics part 2](https://invisiblenetwork.ai/learn/nptel/106106238/19d23fee42aa) (YouTube)
41. [Accelerated Data Analytics part 3](https://invisiblenetwork.ai/learn/nptel/106106238/6f621f455e7d) (YouTube)
42. [Accelerated Data Analytics part 4](https://invisiblenetwork.ai/learn/nptel/106106238/e806b2b22fc3) (YouTube)
43. [Accelerated Machine Learning](https://invisiblenetwork.ai/learn/nptel/106106238/c439548a7a8f) (YouTube)
44. [Introduction to NLP Part 1](https://invisiblenetwork.ai/learn/nptel/106106238/ea5ae9e4ef0e) (YouTube)
45. [Introduction to NLP Part 2](https://invisiblenetwork.ai/learn/nptel/106106238/8a240deaa818) (YouTube)
46. [Applied AI: Smart City ( Intelligent Video Analytics) Session 1 part 1](https://invisiblenetwork.ai/learn/nptel/106106238/a4f4a3aeced0) (YouTube)
47. [Applied AI: Smart City ( Intelligent Video Analytics) Session 1 part 2](https://invisiblenetwork.ai/learn/nptel/106106238/da9dcf6d271d) (YouTube)
48. [Applied AI: Smart City ( Intelligent Video Analytics) Session 2 Deepstream part 1](https://invisiblenetwork.ai/learn/nptel/106106238/4df608c9c6cc) (YouTube)
49. [Applied AI: Smart City ( Intelligent Video Analytics) Session 2 Deepstream part 2](https://invisiblenetwork.ai/learn/nptel/106106238/c5dcfcfc419a) (YouTube)
50. [Introduction to word embedding](https://invisiblenetwork.ai/learn/nptel/106106238/92c557c04dda) (YouTube)
51. [Text classification using word embedding](https://invisiblenetwork.ai/learn/nptel/106106238/a5c15b6bffcb) (YouTube)