SoundScript - Supporting the acquisition of character writing by multisensory integration

Abstract

This work is introducing a new movement sonification method called 'SoundScript' to support the acquisition of character writing by children. SoundScript creates 'sound traces' from the writing trace in real-time during the process of handwriting. The structural correlation of both - optic and acoustic - traces leads to an integrated audio-visual perception of writing with the expected stimulation of multisensory integration sites of the CNS. Data of a pilot study are introduced indicating that the writing kinematics is reproduced more adequately if additional sound traces are available during writing. In the future SoundScript shall be applied to verify if the establishment of internal character representations can be accelerated, if the conciseness of the specific shape of the particular characters can be made stronger and if thereby the efficiency of the handwriting learning process can be enhanced.