Inhalt des Dokuments
Our auditory system with its ability to orient itself in natural acoustic environments can today be considered well researched in many respects. With virtual and augmented realities becoming part of our everyday experience, however, the question becomes important to what extent our perceptual system is able to orient itself in a reality that is not subject to physical laws. Virtual environments can deviate from the rules of the physical world, because of the limited performance of the underlying numerical simulations, because of the limited interaction possibilities of a user with the virtual environment, or because the quality of experience of the virtual environment may consist precisely in crossing the physical boundaries of the real world.
The successful learning of non-physical cues can be considered as a form of neuroplasticity, i.e. an adaptation of the cortical organization of the perceptual apparatus to new experiences and demands. The plasticity of the human auditory system has been shown for source localization with respect to the source azimuth and elevation. In this case, subjects are able to adapt to modified localization cues within approximately one week if training with sensory-motor feedback is performed.
Far less well researched is the question to what extent the perception of distance can be learned in physical environments and can be learned or remapped in non-physical worlds. In addition, the field of audio-visual spatial perception raises the question of the relative weighting and interaction of auditory and visual information. We will therefore combine the production of acoustic stimuli using advanced methods of room acoustical simulation, binaural synthesis, and visual 3-D rendering to conduct psycho-acoustic investigations on the learning of physical and remapped, non-physical cues on distance perception with an investigation of the neural mechanisms of distance perception and plasticity.
Marc Schönwiesner1, Stefan Weinzierl2, Fabian Brinkmann2
1Department of Biology, University of Leipzig
2Audio Communication Group, Technische Universität Berlin