Recognition of human voice utterances from facial surface EMG without using audio signals

Sridhar Poosapadi Arjunan, Hans Weghorn, Dinesh Kant Kumar, Ganesh Naik, Wai Chee Yau

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)


This research examines the evaluation of fSEMG (facial surface Electromyogram) for recognizing speech utterances in English and German language. The raw sampling is performed without sensing any audio signal, and the system is designed for Human Computer Interaction (HCI) based on voice commands. An effective technique is presented, which exploits facial muscle activity of the articulatory muscles and human factors for silent vowel recognition. The muscle signals are reduced to activity parameters by temporal integration, and the matching process is performed by an artificial neural back-propagation network that has to be trained for each individual human user. In the experiments, different style and speed in speaking and different languages were investigated. Cross-validation was used to convert a limited set of single shot experiments into a broader statistical reliability test of the classification method. The experimental results show that this technique yields high recognition rates for all participants in both languages. These results also show that the system is easy to train for a human user, and this all suggests that the described recognition approach can work reliable for simple vowel based commands in HCI, especially when the user speaks one or more languages as also for people who suffer from certain speech disabilities.

Original languageEnglish
Title of host publicationICEIS 2007
Subtitle of host publicationEnterprise Information Systems
EditorsJ Filipe, J Cordeiro, J Cardoso
Number of pages13
ISBN (Electronic)9783540887102
ISBN (Print)9783540887096
Publication statusPublished - 2008
Externally publishedYes
Event9th International Conference on Enterprise Information Systems, ICEIS 2007 - Funchal, Madeira, Portugal
Duration: 12 Jun 200716 Jun 2007

Publication series

NameLecture Notes in Business Information Processing
ISSN (Print)1865-1348


Conference9th International Conference on Enterprise Information Systems, ICEIS 2007
CityFunchal, Madeira


Dive into the research topics of 'Recognition of human voice utterances from facial surface EMG without using audio signals'. Together they form a unique fingerprint.

Cite this