The Enhancement of Interaction for People with Severe Speech and Physical Impairment through the Computer Recognition of Gesture and Manipulation

Publisher Website
Google Scholar
Abstract
The research involves using drama and mime to elicit Intentional behaviors such as gesture and manipulation from people who cannot access a keyboard directly due to severe speech and physical impairment due to cerebral palsy. Although the resulting movements are often imprecise and idiosyncratic, attempts are being made to recognize them by computer. Sensors are being used to monitor continuous signals from the body. Feature extraction and classification techniques involving artificial neural networks are being developed to recognize intention. As part of an early intervention strategy, the system could create the opportunity for children with disabilities to learn through physical interaction and exploration. It is envisioned that the final system could be used to facilitate interaction with a selection of multisensory real and virtual worlds.

This publication has 1 reference indexed in Scilit: