"Through video and real-time performance, we demonstrate a haptic system designed for teaching the pronunciation of English. The version does not involve a virtual reality interface, but the application of this haptic-integrated pedagogical system in a Wii-like system with speech recognition appears achievable with current technology. Using hand-to-hand and hand-to-body haptic engagement in the visual field, somewhat analogous to sign language, sounds and sound processes are “haptically” anchored for enhanced encoding efficiency and recall. One of the striking advantages of such a haptic approach is that it has been shown to better facilitate integration of new sounds into the leaner’s spontaneous speech. The haptic system serves as an accessible channel outside “normal” auditory and visual modalities, for monitoring and adjusting pronunciation accuracy. This body-based haptic framework also holds promise for enhancement of other forms of video/user interface beyond language instruction. The method has been classroom tested with consistent, positive results."
Our presentation will be March 4th, 5th or 6th in Vancouver.