After completing the course, the student:|
* knows the basics of human visual, auditory, and tactile perception.
* knows the basic techniques of multisensory interfaces (manipulation, navigation, and communication) based on examples from virtual worlds.
* can apply the basic techniques of multisensory interfaces (manipulation, navigation, and communication) to state-of-the-art technology.
* is acquainted with the pros and cons of applying multisensory presentation in the design of interfaces (affective appraisal, training transfer, ...) based on examples from virtual worlds and augmented reality.
* is acquainted with psychological test methods to evaluate human performance in virtual worlds and can demonstrate their application to a state-of-the-art example.
* is aware of emerging interface technologies (such as synaesthetic media and brain machine interfaces).
This course covers multimodal (multisensory) perception and interaction.|
The course starts with a discussion of the fascinating world of human visual, auditory and tactile perception and the use of its potential in designing novel interfaces for interacting with virtual worlds.
Furthermore, augmented reality is covered as one particular example of multimodal interaction. In the practical part, students will apply the theoretical background of multimodal perception and multisensory input to concrete state-of-the-art examples (e.g., from virtual or augmented reality).