Bill Acton's Embodiment Blog: kinect

Showing posts with label kinect. Show all posts

Monday, April 9, 2012

Haptic-integrated pronunciation meets Kinect

Clip art: Clker

Linked is a neat Youtube video by University of Washington students showing how haptic feedback can be integrated into Kinect technology. Here is another "Haptic" piece done at Michigan State University giving a nice picture of what some of the haptic technology actually looks and feels like, as well. Obviously, that technology could manage instruction in the gestural, pedagogical movement patterns in EHIEP. With the addition of current voice and speech recognition technology, it won't be long until the complete package is available for virtual reality (haptic-integrated) pronunciation teaching. Keep in touch!

Friday, November 18, 2011

Haptic technology for pronunciation teaching "on hand!"

Hat tip to Matt McLean for pointing me to these two URLs on the development of Omnitouch/
Kinect technology. As you can see in this YouTube video, embodying some of the EHIEP techniques is technically feasible now. In fact, even without the computer interface, the basic embodiment strategy of touching a spot on the other hand or arm or wherever is, from a HICP perspective, probably as effective in anchoring as the visual interface used there itself.

Actually, even if you just project the image on the wall or the desk and use that target as the visual field, it would still create a potentially workable, basic haptic anchoring template. It would not be as effective or portable or engaging as what we have already--using just the visual field of the learner and bilateral haptic anchoring--but it would certainly be a touch better than anything else available today!

Thursday, July 21, 2011

V-Braille meets Kinect in Hapticland

Image credit: www. pmos.org.uk

To get an idea of what a haptic-based, computer-mediated, near virtual reality system for pronunciation teaching might work and look like, imagine a Kinect interface with a V-Braille set up, where you wear gloves that have sensors covering the end of your middle fingers (like a thimble) and quarter-size sensors on both the palm and back of each hand. As has been explored in earlier posts, using the HICP/EHIEP framework, learning new pronunciation should be so easy and efficient that you could learn it "with your eyes closed"--and probably should!

Why the Mikado image? Listening to it right now. What better model of integration (of fun and politics?)

Subscribe to: Posts (Atom)

What is haptic pronunciation teaching?

Basically, it is using gesture, touch and movement to teach pronunciation of English (or any language). What makes this method unique is that it is based on controlled and systematic use of gesture in doing that. (Often the problem with gesture use in language learning is that it can be "crazy" or random or intimidating or inconsistent, or not well-developed and tied to clear outcomes.)

The earlier "Essential Haptic-integrated English Pronunciation (EHIEP) approach," now KINETIK, does a better job of enhancing presentation, modelling, feedback and correction. The method is simple and easy to follow. Once a 30-minute module is finished, teacher and students have a set of techniques to use in class anytime a pronunciation problem or opportunity comes up!

Haptic Preliminaries

I often begin workshops or papers with the comment that in about 40 years in the field I have had just one idea: that the systematic use of body movement is essential to effective and efficient pronunciation instruction. That has never been more relevant than today, with the general deemphasis on pronunciation and introduction of technology into the field. From both perspectives, the "haptic" perspective approach developed here offers great promise. I can at least promise you a "moving" experience!

What is the KINETIK Method?

KINETIK is the name of the new v6.0 haptic pronunciation teaching system. About six years earlier we were using the acronym, "Haptic Integrated Pronunciation for Other/Extended Circle English Speakers" (HIPOECES)--still there in the url of this blog!

Haptic-integrated clinical pronunciation is:

A different way to learn pronunciation, based in part on Arthur Lessac’s notion of “Training the body first.” It is also based on research in the use of movement and touch in learning and training. It:

Looks somewhat like a combination of aerobics, sign language and Taichi

Provides a basic foundation for continued, self-directed pronunciation learning and classroom instruction

Designed for use by relatively untrained teachers but appropriate for all teachers (and learners) of all levels

Focuses on pronunciation used in conversation (not all words in English)

Is a highly “brain-and-body-friendly” system that promotes efficient learning of integrated tasks in general

Designed to promote integrated classroom pronunciation instruction and enable integration of conscious pronunciation work into spontaneous speaking.

Introduction

This blog was formerly named: HIPoeces (pronounced 'hI-pƏ-cIs), basically an approach to teaching English pronunciation to speakers of "outer and expanding" circle Englishes (including that population commonly termed: non-native speakers) but also compatible with the use of local models other than simply Standard" American" or RP. Using Kachru's "Inner, expanding and outer circles" model to characterize the breadth of Englishes and speakers of those, HIPoeces (now HICP) systems focus on developing haptically-centered pedagogical models and methods which can be adapted for teaching the pronunciation of various Englishes as they are spoken and taught by "owners" of those varieties.

In theory, the underlying principles can be applied to teaching the sound system of any language. Most language instructors intuitively use a great deal of movement and tactile anchoring in the classroom. The essential question is how to use that resource systematically, especially so that those learners who are less "haptic" in nature are also "moved" by the method.

Simply put, the HICP model/method is based on the idea of speaking along with arm and hand movement, not all that different from that used in sign languages. Most movement patterns are taken from either typical classroom pronunciation instruction practice or from related fields, such as psychotherapy or sports.

Most blog posts link to research that relates to the general HICP model, that is studies dealing with the role of gesture, touch, movement, learning modalities, learning in output, use of the visual field in learning, and experiential learning.

DEFINITIONS:

"Haptic" techniques- procedures that involve both movement and touch (Obvious examples include clapping hands, tapping feet, or holding an object and shaking it to the rhythm of a poem.)

"HICP techniques" - procedures that are haptic and also explicitly coordinated with phonological structures and/or discourse prosody (For example, clapping hands on primary stressed syllables in multi-syllable words, or doing a dance step on key words in conversational turns.)

"Haptic integration"- The haptic dimension probably functions as much to anchor visual and auditory material as it does to assist the learner in getting the "felt sense" of the sound or sound process. Lack of integration into spontaneous speech being such a serious potential shortcoming of instruction, haptic engagement seems a promising bridge to more accurate fluency.

"Visual field" - in HICP extensive use is made of the visual field in front of the learner. (For example, a modified version of the IPA vowel chart is anchored haptically in the imagination of the learner, directly in front of the upper body, and used for several purposes throughout the program.)