Bill Acton's Embodiment Blog: interface

Showing posts with label interface. Show all posts

Thursday, July 21, 2011

V-Braille meets Kinect in Hapticland

Image credit: www. pmos.org.uk

To get an idea of what a haptic-based, computer-mediated, near virtual reality system for pronunciation teaching might work and look like, imagine a Kinect interface with a V-Braille set up, where you wear gloves that have sensors covering the end of your middle fingers (like a thimble) and quarter-size sensors on both the palm and back of each hand. As has been explored in earlier posts, using the HICP/EHIEP framework, learning new pronunciation should be so easy and efficient that you could learn it "with your eyes closed"--and probably should!

Why the Mikado image? Listening to it right now. What better model of integration (of fun and politics?)

Saturday, July 16, 2011

Insight from the blind

Clip art: Clker

In this 2000 paper, Design of Haptic and Tactile Interfaces for Blind Users, Christian makes an important observation: " . . . At a high level, an interface is a collection of objects and operations one can perform on those objects. The visual representation of an interface on the monitor is only one interpretation. The idea is that when affording the blind access to an interface, one should not convey the visual representation, but rather the interface itself. . . . by translating the semantic level of the interface, one can convey the same constructs that are available to sighted users."

In other words, our use of the visual field is, more accurately, use of the "proprioceptive" field, which involves much more than just sight. We have all observed learners who, in attempting to focus on a sound, will close their eyes to enhance their concentration. Turns out, in a haptically-anchored system (such as EHIEP) for most, doing a full protocol (a set of sounds or sound patterns) or a single sound with eyes closed significantly intensifies concentration--and almost certainly, retention. Compared to "simply" saying a word "blind," the addition of the haptic anchor (movement terminating in touch of both hands in the visual field) creates an extraordinarily "vivid" experience.

Although I have not explored the application of this concept to all protocols systematically, the idea of blocking visual modality extensively is an intriguing possibility. It seems to work surprisingly well in most contexts. Try it. You are in for a "blinding" revelation . . .

Subscribe to: Posts (Atom)

What is haptic pronunciation teaching?

Basically, it is using gesture, touch and movement to teach pronunciation of English (or any language). What makes this method unique is that it is based on controlled and systematic use of gesture in doing that. (Often the problem with gesture use in language learning is that it can be "crazy" or random or intimidating or inconsistent, or not well-developed and tied to clear outcomes.)

The earlier "Essential Haptic-integrated English Pronunciation (EHIEP) approach," now KINETIK, does a better job of enhancing presentation, modelling, feedback and correction. The method is simple and easy to follow. Once a 30-minute module is finished, teacher and students have a set of techniques to use in class anytime a pronunciation problem or opportunity comes up!

Haptic Preliminaries

I often begin workshops or papers with the comment that in about 40 years in the field I have had just one idea: that the systematic use of body movement is essential to effective and efficient pronunciation instruction. That has never been more relevant than today, with the general deemphasis on pronunciation and introduction of technology into the field. From both perspectives, the "haptic" perspective approach developed here offers great promise. I can at least promise you a "moving" experience!

What is the KINETIK Method?

KINETIK is the name of the new v6.0 haptic pronunciation teaching system. About six years earlier we were using the acronym, "Haptic Integrated Pronunciation for Other/Extended Circle English Speakers" (HIPOECES)--still there in the url of this blog!

Haptic-integrated clinical pronunciation is:

A different way to learn pronunciation, based in part on Arthur Lessac’s notion of “Training the body first.” It is also based on research in the use of movement and touch in learning and training. It:

Looks somewhat like a combination of aerobics, sign language and Taichi

Provides a basic foundation for continued, self-directed pronunciation learning and classroom instruction

Designed for use by relatively untrained teachers but appropriate for all teachers (and learners) of all levels

Focuses on pronunciation used in conversation (not all words in English)

Is a highly “brain-and-body-friendly” system that promotes efficient learning of integrated tasks in general

Designed to promote integrated classroom pronunciation instruction and enable integration of conscious pronunciation work into spontaneous speaking.

Introduction

This blog was formerly named: HIPoeces (pronounced 'hI-pƏ-cIs), basically an approach to teaching English pronunciation to speakers of "outer and expanding" circle Englishes (including that population commonly termed: non-native speakers) but also compatible with the use of local models other than simply Standard" American" or RP. Using Kachru's "Inner, expanding and outer circles" model to characterize the breadth of Englishes and speakers of those, HIPoeces (now HICP) systems focus on developing haptically-centered pedagogical models and methods which can be adapted for teaching the pronunciation of various Englishes as they are spoken and taught by "owners" of those varieties.

In theory, the underlying principles can be applied to teaching the sound system of any language. Most language instructors intuitively use a great deal of movement and tactile anchoring in the classroom. The essential question is how to use that resource systematically, especially so that those learners who are less "haptic" in nature are also "moved" by the method.

Simply put, the HICP model/method is based on the idea of speaking along with arm and hand movement, not all that different from that used in sign languages. Most movement patterns are taken from either typical classroom pronunciation instruction practice or from related fields, such as psychotherapy or sports.

Most blog posts link to research that relates to the general HICP model, that is studies dealing with the role of gesture, touch, movement, learning modalities, learning in output, use of the visual field in learning, and experiential learning.

DEFINITIONS:

"Haptic" techniques- procedures that involve both movement and touch (Obvious examples include clapping hands, tapping feet, or holding an object and shaking it to the rhythm of a poem.)

"HICP techniques" - procedures that are haptic and also explicitly coordinated with phonological structures and/or discourse prosody (For example, clapping hands on primary stressed syllables in multi-syllable words, or doing a dance step on key words in conversational turns.)

"Haptic integration"- The haptic dimension probably functions as much to anchor visual and auditory material as it does to assist the learner in getting the "felt sense" of the sound or sound process. Lack of integration into spontaneous speech being such a serious potential shortcoming of instruction, haptic engagement seems a promising bridge to more accurate fluency.

"Visual field" - in HICP extensive use is made of the visual field in front of the learner. (For example, a modified version of the IPA vowel chart is anchored haptically in the imagination of the learner, directly in front of the upper body, and used for several purposes throughout the program.)