Impact of Different Feedback Mechanisms in EMG-based Speech Recognition
by , , ,
Abstract:
This paper reports on our recent research in the feedback effects of Silent Speech. Our technology is based on surface electromyography (EMG) which captures the electrical potentials of the human articulatory muscles rather than the acoustic speech signal. While recognition results are good for loudly articulated speech and when experienced users speak silently, novice users usually achieve far worse results when speaking silently. Since there is no acoustic feedback when speaking silently, we investigate different kinds of feedback modes: no additional feedback except the natural somatosensory feedback (like the touching of the lips), visual feedback using a mirror and indirect acoustic feedback by speaking simultaneously to a previously recorded audio signal. In addition we examine recorded EMG data when the subject speaks audibly and silently in a loud environment to see if the Lombard effect can be observed in Silent Speech, too.
Reference:
Impact of Different Feedback Mechanisms in EMG-based Speech Recognition (Christian Herff, Matthias Janke, Michael Wand, Tanja Schultz), In 12th Annual Conference of the International Speech Communication Association, 2011. (Interspeech 2011)
Bibtex Entry:
@inproceedings{herff2011impact,
  year={2011},
  title={Impact of Different Feedback Mechanisms in EMG-based Speech Recognition},
  note={Interspeech 2011},
  booktitle={12th Annual Conference of the International Speech Communication Association},
  url={https://www.csl.uni-bremen.de/cms/images/documents/publications/HerffSchultz_Interspeech2011.pdf},
  abstract={This paper reports on our recent research in the feedback effects of Silent Speech. Our technology is based on surface electromyography (EMG) which captures the electrical potentials of the human articulatory muscles rather than the acoustic speech signal. While recognition results are good for loudly articulated speech and when experienced users speak silently, novice users usually achieve far worse results when speaking silently. Since there is no acoustic feedback when speaking silently, we investigate different kinds of feedback modes: no additional feedback except the natural somatosensory feedback (like the touching of the lips), visual feedback using a mirror and indirect acoustic feedback by speaking simultaneously to a previously recorded audio signal. In addition we examine recorded EMG data when the subject speaks audibly and silently in a loud environment to see if the Lombard effect can be observed in Silent Speech, too.},
  keywords={Silent speech, Elecromyography, Lack of acoustic feedback, EMG-based speech recognition, Lombard effect},
  author={Herff, Christian and Janke, Matthias and Wand, Michael and Schultz, Tanja}
}