Multi modal gesture identification for HCI using surface EMG

Ganesh R. Naik, Dinesh K. Kumar, Sridhar P. Arjunan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Citations (Scopus)

Abstract

Gesture and Speech comprise the most important modalities of human interaction. There has been a considerable amount of research attempts at incorporating these modalities for natural HCI. This involves challenge ranging from the low level signal processing of multi-modal input to the high level interpretation of natural speech and gesture in HCI. This paper proposes novel methods to recognize the hand gestures and unvoiced utterances using surface Electromyogram (sEMG) signals originating from different muscles. The focus of this work is to establish a simple, yet robust system that can be integrated to identify subtle complex hand gestures and unvoiced speech commands for control of prosthesis and other computer assisted devices. The proposed multi-modal system is able to identify the hand gestures and silent utterances using Independent Component Analysis (ICA) and Integral RMS (IRMS) of sEMG respectively. Training of the sEMG features was done using a designed ANN architecture and the results reported with overall recognition accuracy of 90.33%.

Original languageEnglish
Title of host publicationMindTrek '08
Subtitle of host publicationProceedings of the 12th international conference on Entertainment and media in the ubiquitous era
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery
Pages90-94
Number of pages5
ISBN (Print)9781605581972
DOIs
Publication statusPublished - Oct 2008
Externally publishedYes
Event12th International MindTrek Conference: Entertainment and Media in the Ubiquitous Era, MindTrek'08 - Tampere, Finland
Duration: 7 Oct 20089 Oct 2008

Publication series

NameMindTrek - 12th International MindTrek Conference: Entertainment and Media in the Ubiquitous Era

Conference

Conference12th International MindTrek Conference: Entertainment and Media in the Ubiquitous Era, MindTrek'08
CountryFinland
CityTampere
Period7/10/089/10/08

Keywords

  • Independent component analysis
  • Multi-modal hci
  • Surface electromyography

Fingerprint Dive into the research topics of 'Multi modal gesture identification for HCI using surface EMG'. Together they form a unique fingerprint.

Cite this