Learn · NPTEL

Course10610620056 lectures

Multimodal Interaction

Prof. -Ing. Sebastian Moller and Prof. -Ing. Stefan Hillmann · IIT Madras

Start with lecture 1 At NPTEL

Lectures

Week 1

  1. Introduction Video
  2. Medium vs. Modality Video
  3. Multimedia and Multimodality Video
  4. Modality Relations Video
  5. Characteristics of Multimodal Systems Video
  6. Introduction. Video
  7. Speech Production Video
  8. Hearing - Ear Video
  9. Hearing - Perception Video
  10. Introduction.. Video
  11. The Human Eye Video
  12. Gestlat Perception Video
  13. Resolution and Sensitivity Video
  14. Depth Perception Video
  15. Reading Video

Week 2

  1. Introduction.... Video
  2. Haptics Video
  3. Smell Video
  4. Taste Video
  5. Memory Video
  6. Motorsystem Video
  7. Introduction...... Video
  8. Processing Multiple Signals Video
  9. Multimodal Dual-Tasks Video
  10. Effects of Discongurent Signals Video
  11. Relevance Video
  12. Introduction 1 Video
  13. Introduction 2 Video
  14. Gesture to Space Video
  15. Turn Taking Video
  16. Conclusion Video

Week 3

  1. Introduction....... Video
  2. Overview Video
  3. Automatic Speech Recognition Video
  4. Emotion Recognition Video
  5. Text Recognition Video
  6. Introduction1 Video
  7. Icons Video
  8. Text Generation Video
  9. Text to Speech Video
  10. Speech Generation Video

Week 4

  1. Introduction . Video
  2. Multimodal Interactive Systems Development Video
  3. Introduction . . Video
  4. Virtual Reality Video
  5. Introduction to Audio for Virtual Reality Video
  6. Spatial Hearing Video
  7. Dummy Heads Video
  8. Individuality of HRTFs Video
  9. Sterophony Video
  10. Crosstalk Cancelation Video
  11. Ambisonics Video
  12. Sound Field Synthesis Video
  13. Challenges with Projection-based Systems Video
  14. Capturing of Sound Scenes Video
  15. Closing Remarks Video

Syllabus and materials

At NPTEL, as the course publishes them.

Credits and licence

Institution
IIT Madras
Department
Computer Science and Engineering
Taught by
Prof. -Ing. Sebastian Moller, Prof. -Ing. Stefan Hillmann
Level
Undergraduate
Language
English
Subjects
Computer science, Engineering
Source
NPTEL
Licence
CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
Attribution
NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
Who can watch
NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed