Integration of audio/visual information for use in human-computer intelligent interaction
- 23 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 121-124
- https://doi.org/10.1109/icip.1997.647399
Abstract
Human-computer intelligent interaction (HCII) in virtual environments is a rapidly developing field. Natural human communication is multi-modal, however, most modern computer interfaces rely exclusively on one mode of interaction. We employ a novel approach to integrating multiple modes of human-computer communication. By using auditory and visual features at different levels of integration we explore optimal ways of combining these modalities.Keywords
This publication has 9 references indexed in Scilit:
- Toward the use of gesture in traditional user interfacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Invariant features for 3-D gesture recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Gestural interface to a visual computing environment for molecular biologistsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Visual interpretation of hand gestures for human-computer interaction: a reviewPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- An introduction to multisensor data fusionProceedings of the IEEE, 1997
- Speech/gesture interface to a visual computing environment for molecular biologistsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Gestures with speech for graphic manipulationInternational Journal of Man-Machine Studies, 1993
- Speech, gesture, and discourseDiscourse Processes, 1992
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989