Issues and answers in evaluation of automatic speech recognizers

Publisher Website
Google Scholar
Abstract
An extensive comparison of commercially available automatic speech recognition systems revealed a wide range of performance characteristics. On an isolated word, speaker dependent database, the percentage of errors (i.e., 100% − correct recognition%) ranged over two orders of magnitude for the 10 210 utterances tested. The vocabulary consisted of 11 words (the 10 digits plus “oh”) collected from five males and five females in a moderate office-noise environment. Simultaneous recordings were made with headset and table microphones. Every attempt was made to assure that the systems tested were operating optimally, often with vendor cooperation. Although all systems performed better with data recorded from the headset microphone than with the table microphone, the amount of degradation was not uniform across systems. Special problems and solutions for performing these tests will be discussed.

This publication has 0 references indexed in Scilit: