Course10610620056 lectures
Multimodal Interaction
Prof. -Ing. Sebastian Moller and Prof. -Ing. Stefan Hillmann · IIT Madras
Lectures
Week 1
- Introduction
- Medium vs. Modality
- Multimedia and Multimodality
- Modality Relations
- Characteristics of Multimodal Systems
- Introduction.
- Speech Production
- Hearing - Ear
- Hearing - Perception
- Introduction..
- The Human Eye
- Gestlat Perception
- Resolution and Sensitivity
- Depth Perception
- Reading
Week 2
- Introduction....
- Haptics
- Smell
- Taste
- Memory
- Motorsystem
- Introduction......
- Processing Multiple Signals
- Multimodal Dual-Tasks
- Effects of Discongurent Signals
- Relevance
- Introduction 1
- Introduction 2
- Gesture to Space
- Turn Taking
- Conclusion
Week 3
- Introduction.......
- Overview
- Automatic Speech Recognition
- Emotion Recognition
- Text Recognition
- Introduction1
- Icons
- Text Generation
- Text to Speech
- Speech Generation
Week 4
- Introduction .
- Multimodal Interactive Systems Development
- Introduction . .
- Virtual Reality
- Introduction to Audio for Virtual Reality
- Spatial Hearing
- Dummy Heads
- Individuality of HRTFs
- Sterophony
- Crosstalk Cancelation
- Ambisonics
- Sound Field Synthesis
- Challenges with Projection-based Systems
- Capturing of Sound Scenes
- Closing Remarks
Syllabus and materials
At NPTEL, as the course publishes them.
Credits and licence
- Institution
- IIT Madras
- Department
- Computer Science and Engineering
- Taught by
- Prof. -Ing. Sebastian Moller, Prof. -Ing. Stefan Hillmann
- Level
- Undergraduate
- Language
- English
- Subjects
- Computer science, Engineering
- Source
- NPTEL
- Licence
- CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
- Attribution
- NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
- Who can watch
- NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed
More like this
NPTEL113106082
Course
Welding of Advanced High Strength Steels for Automotive Applications
20 lectures · Video
NPTEL101106082
Course
Rocket Propulsion
36 lectures · Source's player
NPTEL101106031
Course
Acoustic Instabilities in Aerospace Propulsion
41 lectures · Video
NPTEL101106033
Course
Aerospace Propulsion
42 lectures · Video
NPTEL101106037
Course
Combustion
51 lectures · Video
NPTEL101106042
Course
Flight Dynamics II (Stability)
41 lectures · Video
NPTEL101106044
Course
Gas Dynamics
54 lectures · Video
NPTEL101106045
Course
Introduction to CFD
39 lectures · Video
NPTEL105106204
Course
Colloids and Surfaces
48 lectures · Source's player
NPTEL105106205
Course
Polymers: Concepts, Properties, Uses and Sustainability
87 lectures · Source's player
NPTEL103106158
Course
Fluid And Particle Mechanics
73 lectures · Source's player
NPTEL103106220
Course
Artificial Lift
62 lectures · Source's player