Auditory Modulation of Multisensory Representations

Download statistics - Document (COUNTER):

Effenberg, A.O.; Hwang, T.-H.; Ghai, S.; Schmitz, G.: Auditory Modulation of Multisensory Representations. In: Aramaki, M.; Davies, M.E.P.; Kronland-Martinet, R.; Ystad, S. (Eds.): Music Technology with Swing. Cham : Springer, 2018 (Lecture Notes in Computer Science ; 11265), S. 284-311. DOI: https://doi.org/10.1007/978-3-030-01692-0_20

Repository version

To cite the version in the repository, please use this identifier: https://doi.org/10.15488/4949

Selected time period:

year: 
month: 

Sum total of downloads: 388




Thumbnail
Abstract: 
Motor control and motor learning as well as interpersonal coordination are based on motor perception and emergent perceptuomotor representations. At least in early stages motor learning and interpersonal coordination are emerging heavily on visual information in terms of observing others and transforming the information into internal representations to guide owns behavior. With progressing learning, also other perceptual modalities are added when a new motor pattern is established by repeated physical exercises. In contrast to the vast majority of publications on motor learning and interpersonal coordination referring to a certain perceptual modality here we look at the perceptual system as a unitary system coordinating and unifying the information of all involved perceptual modalities. The relation between perceptual streams of different modalities, the intermodal processing and multisensory integration of information as a basis for motor control and learning will be the main focus of this contribution. Multi-/intermodal processing of perceptual streams results in multimodal representations and opens up new approaches to support motor learning and interpersonal coordination: Creating an additional perceptual stream adequately auditory movement information can be generated suitable to be integrated with information of other modalities and thereby modulating the resulting perceptuomotor representations without the need of attention and higher cognition. Here, the concept of a movement defined real-time acoustics is used to serve the auditory system in terms of an additional movement-auditory stream. Before the computational approach of kinematic real-time sonification is finally described, a special focus is directed to the level of adaptation modules of the internal models. Furthermore, this concept is compared with different approaches of additional acoustic movement information. Moreover, a perspective of this approach is given in a broad spectrum of new applications of supporting motor control and learning in sports and motor rehabilitation as well as a broad spectrum of joint action and interpersonal coordination between humans but also concerning human-robot-interaction. The final publication is available at Springer via https://doi.org/10.1007/978-3-030-01692-0_20.
License of this version: Es gilt deutsches Urheberrecht. Das Dokument darf zum eigenen Gebrauch kostenfrei genutzt, aber nicht im Internet bereitgestellt oder an Außenstehende weitergegeben werden.
Document Type: BookPart
Publishing status: acceptedVersion
Issue Date: 2018
Appears in Collections:Philosophische Fakultät

distribution of downloads over the selected time period:

downloads by country:

pos. country downloads
total perc.
1 image of flag of Germany Germany 201 51.80%
2 image of flag of United States United States 68 17.53%
3 image of flag of France France 13 3.35%
4 image of flag of Czech Republic Czech Republic 11 2.84%
5 image of flag of China China 11 2.84%
6 image of flag of Russian Federation Russian Federation 10 2.58%
7 image of flag of United Kingdom United Kingdom 8 2.06%
8 image of flag of India India 7 1.80%
9 image of flag of No geo information available No geo information available 6 1.55%
10 image of flag of Australia Australia 5 1.29%
    other countries 48 12.37%

Further download figures and rankings:


Hinweis

Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.

Search the repository


Browse