Evaluating 3D Sculpting Through Natural User Interfaces Across Multiple Devices

Bradley Wesson, Brett Wilkinson

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


    Traditional digital sculpting software offers a wealth of specificpurpose tools discouraging artist play in the environment. These tools interact with the projection of the geometry to a flat screen, through the use of a mouse or graphics tablet-devices poorly suited to this domain given their lack of a direct method for indicating the depth of interactions. This project investigated the use of full body gestures to facilitate such artistic expression. Skeletal data drives a natural user interface providing users with the ability to sculpt a virtual clay-like substance into different forms. The application was tested in this mode, as well as with a supporting secondary interface for perceived and measured speed and accuracy, users’ reported fatigue and ease of use. This secondary interface provided various touch gestures on a smartphone held in the user’s right hand, while supplementing the positional data provided by the Kinect with orientation data. Results indicated that users were able learn the interface quickly, but depth-perception, grip detection and speech performance were lacking. The secondary interface resulted in fewer undo events, though users reported it as offering little benefit and awkward to use.

    Original languageEnglish
    Title of host publicationComputer-Human Interaction
    Subtitle of host publicationCognitive Effects of Spatial Interaction, Learning, and Ability - 25th Australian Computer-Human Interaction Conference, OzCHI 2013, Revised and Extended Papers
    EditorsTheodor Wyeld, Paul Calder, Haifeng Shen
    Number of pages18
    ISBN (Print)9783319169392
    Publication statusPublished - 2015

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349


    • Artistic expression
    • Kinect
    • Natural user interfaces
    • Smartphone


    Dive into the research topics of 'Evaluating 3D Sculpting Through Natural User Interfaces Across Multiple Devices'. Together they form a unique fingerprint.

    Cite this