Adaptive user perspective rendering for Handheld Augmented Reality

Peter Mohr, Markus Tatzgern, Jens Grubert, Dieter Schmalstieg, Denis Kalkofen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

13 Citations (Scopus)

Abstract

Handheld Augmented Reality commonly implements some variant of magic lens rendering, which turns only a fraction of the users real environment into AR while the rest of the environment remains unaffected. Since handheld AR devices are commonly equipped with video see-through capabilities, AR magic lens applications often suffer from spatial distortions, because the AR environment is presented from the perspective of the camera of the mobile device. Recent approaches counteract this distortion based on estimations of the users head position, rendering the scene from the user's perspective. To this end, approaches usually apply face-tracking algorithms on the front camera of the mobile device. However, this demands high computational resources and therefore commonly affects the performance of the application beyond the already high computational load of AR applications. In this paper, we present a method to reduce the computational demands for user perspective rendering by applying lightweight optical flow tracking and an estimation of the users motion before head tracking is started. We demonstrate the suitability of our approach for computationally limited mobile devices and we compare it to device perspective rendering, to head tracked user perspective rendering, as well as to fixed point of view user perspective rendering.

Original languageEnglish
Title of host publication2017 IEEE Symposium on 3D User Interfaces, 3DUI 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages176-181
Number of pages6
ISBN (Electronic)9781509067169
DOIs
Publication statusPublished - 6 Apr 2017
Externally publishedYes
Event2017 IEEE Symposium on 3D User Interfaces, 3DUI 2017 - Los Angeles, United States
Duration: 18 Mar 201719 Mar 2017

Publication series

Name2017 IEEE Symposium on 3D User Interfaces, 3DUI 2017 - Proceedings

Conference

Conference2017 IEEE Symposium on 3D User Interfaces, 3DUI 2017
Country/TerritoryUnited States
CityLos Angeles
Period18/03/1719/03/17

Keywords

  • Augmented Reality
  • User Perspective Rendering

Fingerprint

Dive into the research topics of 'Adaptive user perspective rendering for Handheld Augmented Reality'. Together they form a unique fingerprint.

Cite this