Showing posts with label CAPT. Show all posts
Showing posts with label CAPT. Show all posts

Friday, November 23, 2012

Do-it-Yourself! haptic-integrated pronunciation teaching


Clip art: Clker
Clip art: Clker
Haptic work is, by definition . . . touching! As explored in several previous posts, there are a wide range of conditions under which haptic anchoring of movement, visual images and sound may or may not be effective in instruction. (According to new research, by Patterson and colleagues at the University of Liecester, summarized by Science Daily, there may even be a bias in favor of those of us over the age of 65 in responding to the typical "fuzziness" of haptic cinema!)

One of the most striking discoveries in our work has been the realization that some of the EHIEP pedagogical movement patterns can be taught well face-to-face but others may be better introduced by a video model, especially vowels, vowel "compaction" and intonation. That video model can be the instructor, him or herself, or someone else--such as in the EHIEP system of videos and student workbooks that I am developing, of course! Why that should be is complex but understood (See this blogpost by Grant on http://filmanalytical.blogspot.ca/)

In essence, it is emotionally and interpersonally very powerful. In some contexts, either because of the personality of the instructor or the class, video is a better option for perhaps half of the PMPs. One reason for that is the impact of eye contact on mirroring in a classroom setting. In essence, vivid "moving" visual feedback from students, whether negative  or positive can dramatically undermine an instructor's ability to teach PMPs. Once they are introduced, however, classroom use of a PMP to anchor vowels, stress, rhythm, intonation or pitch/volume/pace seems to be less susceptible to disruption.

Bottom line: It takes training to do pronunciation work of any kind effectively or efficiently. Either you get trained or have somebody else do it for you, either in your program or through technology. Haptic video and its post-production technology is very promising. I am tempted to use a term like "CAPT Video," Computer-Assisted-Pronunciation-Teaching with Video, were there not already a near-relevant song by that name .  .  .  

Wednesday, November 21, 2012

Pronunciation & body & media fit

Clip art: Clker
If you have been reading the blog occasionally, you are aware of the basis of the EHIEP model: (a) initial pronunciation teaching and (b) practice outsourced to video with subsequent (c) integrated use in the classroom, (d) strong haptic engagement (movement and touch) and (e) somatic or body awareness and training. For the latter piece, body monitoring, maybe what we need is something like the "BodyMedia FIT" system. I love the company's come on line: "Your body talks. We listen." Wish I had the spare change to buy one of those arm bands, just for fun. The research on effectiveness of the technology, using web-based systems,  is interesting. "Body training," in general, is biofeedback of one kind or another. This type of technology could easily be adapted to provide constant feedback on the quality of movement, relaxation, energy expenditure and body resonance. For much less money and hassle--with a modicum of self-discipline and persistence, learners can experience the same kind of integrated experience of speaking and pronunciation change with us. The future, however, is with technology such as this linked to CAPT (see previous post.) and haptic cinema. But if you have difficulty consistently managing your "current classroom body image" and its caloric correlates, consider "arming yourself" with such a band. 

Monday, November 19, 2012

Disembodied pronunciation: computer generated, animated images of learners' inappropriate articulation


Clip art: Clker
Clip art: Clker
May start a new series of blogposts focusing on amazing-looking pronunciation techniques that, from a HICPR perspective, are so thoroughly disembodied or "dys-haptic" (generally depending heavily on only visual modalities, lacking a somatic, physical basis) such that chances of them working are probably not all that good, at best, such as this one:
"Improvement of animated articulatory gesture extracted from speech for pronunciation training," by Manosavan, Katsurada, Hayashi, Zhu, Nitta of Toyohashi University, a paper from the 2012 IEEE Convention--available for 31 bucks to nonmembers. (Have not read the full paper, just the abstract. My general policy is to pay for no research papers that cost more than 6 Starbucks Vente Carmel Frappuccinoes.) Computer-assisted Pronunciation Training (CAPT) is probably the future of the field, but a system that creates a moving cartoon-like representation of what a learner is doing wrong and then juxtaposes that with an animated image of how to do it right cannot possibly work effectively or efficiently-expect perhaps for those who are CAPT designers and gamers. (What do they need appropriate pronunciation for anyway?) 

However, if that video image were to be merged with "haptic cinema" technique and technology, (linked is a very "a-peeling" example, in fact!) they may still be on to something.