Using Ultrasonic Hand Tracking to Augment Motion Analysis Based Recognition of Manipulative Gestures
- 13 December 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 152-159
- https://doi.org/10.1109/iswc.2005.54
Abstract
The paper demonstrates how ultrasonic hand tracking can be used to improve the performance of a wearable, accelerometer and gyroscope based activity recognition system. Specifically we target the recognition of manipulative gestures of the type found in assembly and maintenance tasks. We discuss how relevant information can be extracted from the ultrasonic signal despite problems with low sampling rate, occlusions and reflections that occur in this type of application. We then introduce several methods of fusing the ultrasound and motion sensor information. We evaluate our methods on an experimental data set that contains 21 different actions performed repeatedly by three different subjects during simulated bike repair. Due to the complexity of the recognition tasks with many similar and vaguely defined actions and person independent training both the ultrasound and motion sensors perform poorly on their own. However with our fusion methods recognition rates well over 90% can be achieved for most activities. In extreme case recognition rates go up from just over 50% for separate classifications to nearly 89% with our fusion methods.Keywords
This publication has 10 references indexed in Scilit:
- Tracking moving devices with the cricket location systemPublished by Association for Computing Machinery (ACM) ,2004
- Recognizing Workshop Activity Using Body Worn Microphones and AccelerometersPublished by Springer Nature ,2004
- Activity Recognition from User-Annotated Acceleration DataPublished by Springer Nature ,2004
- Recognizing human motion with multiple acceleration sensorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Context awareness by analysing accelerometer dataPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Location systems for ubiquitous computingComputer, 2001
- The Cricket location-support systemPublished by Association for Computing Machinery (ACM) ,2000
- What shall we teach our pants?Published by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- The anatomy of a context-aware applicationPublished by Association for Computing Machinery (ACM) ,1999
- A new location technique for the active officeIEEE Wireless Communications, 1997