Multimodal 'eyes-free' interaction techniques for wearable devices
Top Cited Papers
- 5 April 2003
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 473-480
- https://doi.org/10.1145/642611.642694
Abstract
Mobile and wearable computers present input/output prob-lems due to limited screen space and interaction techniques. When mobile, users typically focus their visual attention on navigating their environment - making visually demanding interface designs hard to operate. This paper presents two multimodal interaction techniques designed to overcome these problems and allow truly mobile, 'eyes-free' device use. The first is a 3D audio radial pie menu that uses head gestures for selecting items. An evaluation of a range of different audio designs showed that egocentric sounds re-duced task completion time, perceived annoyance, and al-lowed users to walk closer to their preferred walking speed. The second is a sonically enhanced 2D gesture recognition system for use on a belt-mounted PDA. An evaluation of the system with and without audio feedback showed users' ges-tures were more accurate when dynamically guided by au-dio-feedback. These novel interaction techniques demon-strate effective alternatives to visual-centric interface de-signs on mobile devices.Keywords
This publication has 10 references indexed in Scilit:
- Overcoming the Lack of Screen Space on Mobile ComputersPersonal and Ubiquitous Computing, 2002
- Gestural and audio metaphors as a means of control for mobile devicesPublished by Association for Computing Machinery (ACM) ,2002
- Fundamentals of Wearable Computers and Augmented RealityPublished by Taylor & Francis ,2001
- Nomadic radioACM Transactions on Computer-Human Interaction, 2000
- Using nonspeech sounds to provide navigation cuesACM Transactions on Computer-Human Interaction, 1998
- Head pointing and speech control as a hands-free interface to desktop computingPublished by Association for Computing Machinery (ACM) ,1998
- Squeeze me, hold me, tilt me! An exploration of manipulative user interfacesPublished by Association for Computing Machinery (ACM) ,1998
- Bullseye! when Fitts' law doesn't fitPublished by Association for Computing Machinery (ACM) ,1998
- A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interactionPublished by Association for Computing Machinery (ACM) ,1996
- Multidimensional audio window managementInternational Journal of Man-Machine Studies, 1991