Transfer Learning in Sign language
- 1 June 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 8 (10636919) , 1-8
- https://doi.org/10.1109/cvpr.2007.383346
Abstract
We build word models for American Sign Language (ASL) that transfer between different signers and different aspects. This is advantageous because one could use large amounts of labelled avatar data in combination with a smaller amount of labelled human data to spot a large number of words in human data. Transfer learning is possible because we represent blocks of video with novel intermediate discriminative features based on splits of the data. By constructing the same splits in avatar and human data and clustering appropriately, our features are both discriminative and semantically similar: across signers similar features imply similar words. We demonstrate transfer learning in two scenarios: from avatar to a frontally viewed human signer and from an avatar to human signer in a 3/4 view.Keywords
This publication has 17 references indexed in Scilit:
- Aligning ASL for Statistical Translation Using a Discriminative Word ModelPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Unsupervised Modeling of Signs Embedded in Continuous SentencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Modality-dependent aspects of sign language production: Evidence from slips of the hands and their repairs in German Sign LanguagePublished by Cambridge University Press (CUP) ,2002
- Recognition of gestures in Arabic sign language using neuro-fuzzy systemsArtificial Intelligence, 2001
- SIGN LANGUAGE RECOGNITION BASED ON HMM/ANN/DPInternational Journal of Pattern Recognition and Artificial Intelligence, 2000
- HandTalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual HumanPublished by Springer Nature ,2000
- Real-time American sign language recognition using desk and wearable computer based videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- A dynamic gesture recognition system for the Korean sign language (KSL)IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1996
- Issues in Providing Mental Health Services to Hearing-Impaired PersonsPsychiatric Services, 1991