# Neural Networks for Signal Processing - I - Institution: IISc Bangalore - Department: Electrical Engineering - Teacher: Prof. Shayan Srinivasa Garani - Level: Graduate - Language: English - Subjects: Engineering - Source: [NPTEL](https://nptel.ac.in/courses/108108148) - Licence: [CC BY-NC-SA](https://nptel.ac.in/faq) (Non-commercial use only.) - Syllabus: [at the source](https://nptel.ac.in/courses/108108148) - Who can watch: Tweens profiles and older (sources give no ratings; placed by Invisible Network from the source's own words) This will be an introductory graduate level course in neural networks for signal processing. The course starts with a motivation of how the human brain is inspirational to building artificial neural networks. The neural networks are viewed as directed graphs with various network topologies towards learning tasks driven by optimization techniques. The course covers Rosenblatt’s perceptron, regression modeling, multilayer perceptron (MLP), kernel methods and radial basis functions (RBF), support vector machines (SVM), regularization theory and principal component analysis (Hebbian and kernel based). Towards the end, topics such as convolutional neural networks etc. that are based on the MLP will be touched upon. The course will have assignments that are theoretical and computer based working with actual data. Intended audience: Graduate level, Senior UG can also participate, engineers and scientists within related industry. Prerequisites: Basic mathematical background in probability, linear algebra, signals and systems or equivalent. ## Lectures 1. [The Human Brain](https://invisiblenetwork.ai/learn/nptel/108108148/29d152771bac) (YouTube) 2. [Introduction to Neural Networks](https://invisiblenetwork.ai/learn/nptel/108108148/f8f324809d2c) (YouTube) 3. [Models of a neuron](https://invisiblenetwork.ai/learn/nptel/108108148/142c6c322784) (YouTube) 4. [Feedback and network architectures](https://invisiblenetwork.ai/learn/nptel/108108148/40e1d98b5e80) (YouTube) 5. [Knowledge representation](https://invisiblenetwork.ai/learn/nptel/108108148/d8d410245e53) (YouTube) 6. [Prior information and invariances](https://invisiblenetwork.ai/learn/nptel/108108148/37344ea405c5) (YouTube) 7. [Learning processes](https://invisiblenetwork.ai/learn/nptel/108108148/312ec736b6f3) (YouTube) 8. [Perceptron 1](https://invisiblenetwork.ai/learn/nptel/108108148/894a5d429c72) (YouTube) 9. [Perceptron 2](https://invisiblenetwork.ai/learn/nptel/108108148/b77f9621f21d) (YouTube) 10. [Batch perceptron algorithm](https://invisiblenetwork.ai/learn/nptel/108108148/0dc2f1e43460) (YouTube) 11. [Perceptron and Bayes classifier](https://invisiblenetwork.ai/learn/nptel/108108148/2cc8bd9f7ffa) (YouTube) 12. [Linear regression 1](https://invisiblenetwork.ai/learn/nptel/108108148/e2e70c7fd733) (YouTube) 13. [Linear regression 2](https://invisiblenetwork.ai/learn/nptel/108108148/750401e85524) (YouTube) 14. [Linear regression 3](https://invisiblenetwork.ai/learn/nptel/108108148/da83398f500c) (YouTube) 15. [Logistic regression](https://invisiblenetwork.ai/learn/nptel/108108148/a40a75362cdf) (YouTube) 16. [Multi-layer perceptron 1](https://invisiblenetwork.ai/learn/nptel/108108148/624b9b11f82d) (YouTube) 17. [Multi-layer perceptron 2](https://invisiblenetwork.ai/learn/nptel/108108148/312cfc268cc9) (YouTube) 18. [Back propagation 1](https://invisiblenetwork.ai/learn/nptel/108108148/6ab2934fe21f) (YouTube) 19. [Back propagation 2](https://invisiblenetwork.ai/learn/nptel/108108148/15993dc9580e) (YouTube) 20. [XOR problem](https://invisiblenetwork.ai/learn/nptel/108108148/c808d24cfc30) (YouTube) 21. [Universal approximation theorem](https://invisiblenetwork.ai/learn/nptel/108108148/144a13a4f77e) (YouTube) 22. [Complexity Regularization and Cross validation](https://invisiblenetwork.ai/learn/nptel/108108148/28d8c00fe17c) (YouTube) 23. [Convolutional Neural Networks (CNN)](https://invisiblenetwork.ai/learn/nptel/108108148/8648cea917d7) (YouTube) 24. [Cover’s Theorem](https://invisiblenetwork.ai/learn/nptel/108108148/202210ff95db) (YouTube) 25. [Multivariate interpolation problem](https://invisiblenetwork.ai/learn/nptel/108108148/85c5f5290935) (YouTube) 26. [Radial basis functions (RBF)](https://invisiblenetwork.ai/learn/nptel/108108148/7d6613c0442a) (YouTube) 27. [Recursive least squares algorithm](https://invisiblenetwork.ai/learn/nptel/108108148/81fa4551fbe5) (YouTube) 28. [Comparison of RBF with MLP](https://invisiblenetwork.ai/learn/nptel/108108148/5adcc2297dbe) (YouTube) 29. [Kernel regression using RBFs](https://invisiblenetwork.ai/learn/nptel/108108148/321083023af1) (YouTube) 30. [Kernel Functions](https://invisiblenetwork.ai/learn/nptel/108108148/a47546ac69d2) (YouTube) 31. [Basics of constrained optimization](https://invisiblenetwork.ai/learn/nptel/108108148/7236b12545fc) (YouTube) 32. [Optimization with equality constraint](https://invisiblenetwork.ai/learn/nptel/108108148/231cd9349781) (YouTube) 33. [Optimization with inequality constraint](https://invisiblenetwork.ai/learn/nptel/108108148/6928f60396c9) (YouTube) 34. [Support Vector Machines (SVM)](https://invisiblenetwork.ai/learn/nptel/108108148/2cd3ffe82a5c) (YouTube) 35. [Optimal hyperplane for linearly separable patterns](https://invisiblenetwork.ai/learn/nptel/108108148/ceaf5faba5c3) (YouTube) 36. [Quadratic optimization for finding optimal hyperplane](https://invisiblenetwork.ai/learn/nptel/108108148/bd589f233ba6) (YouTube) 37. [Optimal hyperplane for non-linearly separable patterns](https://invisiblenetwork.ai/learn/nptel/108108148/0d9395655ae4) (YouTube) 38. [Inner product kernel and Mercer’s theorem](https://invisiblenetwork.ai/learn/nptel/108108148/291f84048218) (YouTube) 39. [Optimal design of an SVM](https://invisiblenetwork.ai/learn/nptel/108108148/15df241ae99f) (YouTube) 40. [ε-insensitive loss function](https://invisiblenetwork.ai/learn/nptel/108108148/5ba12cb6fd5f) (YouTube) 41. [XOR problem revisited using SVMs](https://invisiblenetwork.ai/learn/nptel/108108148/07d6c8241d3c) (YouTube) 42. [Hilbert Space](https://invisiblenetwork.ai/learn/nptel/108108148/48dd8c9e2ff0) (YouTube) 43. [Reproducing Kernel Hilbert Space](https://invisiblenetwork.ai/learn/nptel/108108148/d170a406165e) (YouTube) 44. [Representer Theorem](https://invisiblenetwork.ai/learn/nptel/108108148/dee6c3e311c1) (YouTube) 45. [Generalized applicability of the representer theorem](https://invisiblenetwork.ai/learn/nptel/108108148/e4339a305ee8) (YouTube) 46. [Regularization Theory](https://invisiblenetwork.ai/learn/nptel/108108148/e738ad4d648d) (YouTube) 47. [Euler-Lagrange Equation](https://invisiblenetwork.ai/learn/nptel/108108148/81af21005f8c) (YouTube) 48. [Regularization Networks](https://invisiblenetwork.ai/learn/nptel/108108148/b65dcf040170) (YouTube) 49. [Generalized RBF networks](https://invisiblenetwork.ai/learn/nptel/108108148/9e4413ad72ce) (YouTube) 50. [XOR problem revisited using RBF](https://invisiblenetwork.ai/learn/nptel/108108148/d53847419164) (YouTube) 51. [Structural Risk Minimization](https://invisiblenetwork.ai/learn/nptel/108108148/57e04276c15b) (YouTube) 52. [Bias-Variance Dilemma](https://invisiblenetwork.ai/learn/nptel/108108148/9f3f0f3ea651) (YouTube) 53. [Estimation of regularization parameters](https://invisiblenetwork.ai/learn/nptel/108108148/8972dabfc151) (YouTube) 54. [Basics of L1 regularization](https://invisiblenetwork.ai/learn/nptel/108108148/2b102c400295) (YouTube) 55. [Grafting](https://invisiblenetwork.ai/learn/nptel/108108148/6f3d6268a42a) (YouTube) 56. [VC dimension](https://invisiblenetwork.ai/learn/nptel/108108148/d7614f93630a) (YouTube) 57. [Autoencoders](https://invisiblenetwork.ai/learn/nptel/108108148/8213b551d1d9) (YouTube) 58. [Denoising Autoencoders](https://invisiblenetwork.ai/learn/nptel/108108148/e0be7a738457) (YouTube) 59. [Kernel PCA](https://invisiblenetwork.ai/learn/nptel/108108148/15beeabcb264) (YouTube) 60. [Hebbian based maximum eigen filter -1](https://invisiblenetwork.ai/learn/nptel/108108148/06d265c06dcf) (YouTube) 61. [Hebbian based maximum eigen filter -2](https://invisiblenetwork.ai/learn/nptel/108108148/4083fdb47833) (YouTube) 62. [Hebbian based maximum eigen filter - 3](https://invisiblenetwork.ai/learn/nptel/108108148/882b6e5afb2c) (YouTube) 63. [Demo – Perceptron](https://invisiblenetwork.ai/learn/nptel/108108148/945b6ffaa6b6) (YouTube) 64. [Demo – Motivation for CNN](https://invisiblenetwork.ai/learn/nptel/108108148/5e3c041b93f6) (YouTube) 65. [Back propagation in Convolutional Neural Network](https://invisiblenetwork.ai/learn/nptel/108108148/e4ad06e14efe) (YouTube) 66. [Ethics in AI research and coverage summary](https://invisiblenetwork.ai/learn/nptel/108108148/0a0be82f60d7) (YouTube)