Progress Observation in Augmented Reality Assembly Tutorials Using Dynamic Hand Gesture Recognition

Tania Kairnel, Ana Stanescu, Peter Mohr, Dieter Schmalstieg, Denis Kalkofen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

We propose a proof-of-concept augmented reality assembly tutorial application that uses a video-see-through headset to guide the user through assembly instruction steps. It is solely controlled by observing the user's physical interactions with the workpiece. The tutorial progresses automatically, making use of hand gesture classification to estimate the progression to the next instruction. For dynamic hand gesture classification, we integrate a neural network module to classify the user's hand movement in real time. We evaluate the learned model used in our application to provide insights into the performance of implicit gestural interactions.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
PublisherInstitute of Electrical and Electronics Engineers
Pages957-958
Number of pages2
ISBN (Electronic)9798350374490
DOIs
Publication statusPublished - 29 May 2024
Event2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 - Orlando, United States
Duration: 16 Mar 202421 Mar 2024

Publication series

NameProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024

Conference

Conference2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
Country/TerritoryUnited States
CityOrlando
Period16/03/2421/03/24

Keywords

  • Augmented Reality
  • Hand Gestures

Fingerprint

Dive into the research topics of 'Progress Observation in Augmented Reality Assembly Tutorials Using Dynamic Hand Gesture Recognition'. Together they form a unique fingerprint.

Cite this