|Clip art: Clker|
Actually, I like that idea, combing or pairing (haptic-anchored) gesture with paralanguage. In EHIEP work we do something of that with pitch, rate and fluency, using special gestures terminating in touch, what we refer to as pedagogical movement patterns (PMPs), that function to control those three features of speech in various ways (typically done in either modelling or error correction or expressive oral reading of fixed texts). To see a demonstration of each go to the Demo page on the AH-EPS website:
pitch - the Expressiveness PMP
rate - the Rhythm Fight Club PMP
fluency - the Tai Chi Fluency PMP
We have yet to figure out an effective PMP for loudness. If you can think of one . . . give us a shout!
Keep in touch.