Evaluating organic 3D sculpting using Natural User Interfaces with the Kinect

This project investigates the use of full body gestures to facilitate artistic expression. Skeletal data tracked with a Kinect sensor is used to drive a natural user interface providing users with the ability to sculpt a virtual claylike substance into different forms. Various gestures allow interaction with the scene to adjust brush size, augment the virtual form and orient the user's view. Several verbal commands offer system-wide commands to return the scene to its initial state, reset the camera position, and undo interactions. Test participants use these interactions to transform a spherical "blob" into a teapot by extruding the spout and handle and flattening the top. A survey completed by the participants has indicated that this action is enjoyable and immersive.