TutAR: Semi-automatic generation of augmented reality tutorials for medical education

Daniel Eckhoff; Christian Sandor; Denis Kalkofen; Ulrich Eck; Christian Lins; Andreas Hein

doi:10.1109/ISMAR-Adjunct.2018.00131

TutAR: Semi-automatic generation of augmented reality tutorials for medical education

Daniel Eckhoff, Christian Sandor, Denis Kalkofen, Ulrich Eck, Christian Lins, Andreas Hein

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

14 Citations (Scopus)

Abstract

With Augmented Reality (AR) on Optical-See-Through-Head-Mounted Displays (OST-HMD), users can observe the real world and computer graphics at the same time. In this work, we present TutAR, a pipeline that semi-automatically creates AR tutorials out of 2D RGB videos. TutAR extracts relevant 3D hand motion from the input video. The derived motion will be displayed as an animated 3D hand relative to the human body and plays synchronously with the motion in the video on an OST-HMD.

Original language	English
Title of host publication	Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
Publisher	Institute of Electrical and Electronics Engineers
Pages	430-431
Number of pages	2
ISBN (Electronic)	9781538675922
DOIs	https://doi.org/10.1109/ISMAR-Adjunct.2018.00131
Publication status	Published - 19 Apr 2018
Externally published	Yes

Publication series

Name	Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018

Keywords

Augmented Reality
Motion extraction
Video tutorials

Access to Document

10.1109/ISMAR-Adjunct.2018.00131Licence: In Copyright

Cite this

Eckhoff, D., Sandor, C., Kalkofen, D., Eck, U., Lins, C., & Hein, A. (2018). TutAR: Semi-automatic generation of augmented reality tutorials for medical education. In Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018 (pp. 430-431). Article 8699222 (Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ISMAR-Adjunct.2018.00131

Eckhoff, Daniel ; Sandor, Christian ; Kalkofen, Denis et al. / TutAR : Semi-automatic generation of augmented reality tutorials for medical education. Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018. Institute of Electrical and Electronics Engineers, 2018. pp. 430-431 (Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018).

@inproceedings{fd07c4c624244ace95e248a1190a77f1,

title = "TutAR: Semi-automatic generation of augmented reality tutorials for medical education",

abstract = "With Augmented Reality (AR) on Optical-See-Through-Head-Mounted Displays (OST-HMD), users can observe the real world and computer graphics at the same time. In this work, we present TutAR, a pipeline that semi-automatically creates AR tutorials out of 2D RGB videos. TutAR extracts relevant 3D hand motion from the input video. The derived motion will be displayed as an animated 3D hand relative to the human body and plays synchronously with the motion in the video on an OST-HMD.",

keywords = "Augmented Reality, Motion extraction, Video tutorials",

author = "Daniel Eckhoff and Christian Sandor and Denis Kalkofen and Ulrich Eck and Christian Lins and Andreas Hein",

year = "2018",

month = apr,

day = "19",

doi = "10.1109/ISMAR-Adjunct.2018.00131",

language = "English",

series = "Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018",

publisher = "Institute of Electrical and Electronics Engineers",

pages = "430--431",

booktitle = "Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018",

address = "United States",

}

Eckhoff, D, Sandor, C, Kalkofen, D, Eck, U, Lins, C & Hein, A 2018, TutAR: Semi-automatic generation of augmented reality tutorials for medical education. in Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018., 8699222, Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018, Institute of Electrical and Electronics Engineers, pp. 430-431. https://doi.org/10.1109/ISMAR-Adjunct.2018.00131

TutAR: Semi-automatic generation of augmented reality tutorials for medical education. / Eckhoff, Daniel; Sandor, Christian; Kalkofen, Denis et al.
Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018. Institute of Electrical and Electronics Engineers, 2018. p. 430-431 8699222 (Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - TutAR

T2 - Semi-automatic generation of augmented reality tutorials for medical education

AU - Eckhoff, Daniel

AU - Sandor, Christian

AU - Kalkofen, Denis

AU - Eck, Ulrich

AU - Lins, Christian

AU - Hein, Andreas

PY - 2018/4/19

Y1 - 2018/4/19

N2 - With Augmented Reality (AR) on Optical-See-Through-Head-Mounted Displays (OST-HMD), users can observe the real world and computer graphics at the same time. In this work, we present TutAR, a pipeline that semi-automatically creates AR tutorials out of 2D RGB videos. TutAR extracts relevant 3D hand motion from the input video. The derived motion will be displayed as an animated 3D hand relative to the human body and plays synchronously with the motion in the video on an OST-HMD.

AB - With Augmented Reality (AR) on Optical-See-Through-Head-Mounted Displays (OST-HMD), users can observe the real world and computer graphics at the same time. In this work, we present TutAR, a pipeline that semi-automatically creates AR tutorials out of 2D RGB videos. TutAR extracts relevant 3D hand motion from the input video. The derived motion will be displayed as an animated 3D hand relative to the human body and plays synchronously with the motion in the video on an OST-HMD.

KW - Augmented Reality

KW - Motion extraction

KW - Video tutorials

UR - http://www.scopus.com/inward/record.url?scp=85065549526&partnerID=8YFLogxK

U2 - 10.1109/ISMAR-Adjunct.2018.00131

DO - 10.1109/ISMAR-Adjunct.2018.00131

M3 - Conference contribution

T3 - Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018

SP - 430

EP - 431

BT - Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018

PB - Institute of Electrical and Electronics Engineers

ER -

Eckhoff D, Sandor C, Kalkofen D, Eck U, Lins C, Hein A. TutAR: Semi-automatic generation of augmented reality tutorials for medical education. In Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018. Institute of Electrical and Electronics Engineers. 2018. p. 430-431. 8699222. (Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018). doi: 10.1109/ISMAR-Adjunct.2018.00131

TutAR: Semi-automatic generation of augmented reality tutorials for medical education

Abstract

Publication series

Keywords

Access to Document

Other files and links

Fingerprint

Cite this