Remote Control by Body Movement in Synchrony with Orbiting Widgets: an Evaluation of TraceMatch

Christopher Clarke, Alessio Bellino, Augusto Esteves and Hans Gellersen.

PACM on Interactive, Mobile, Wearable and Ubiquitous Technologies: Volume 1 Issue 3, September 2017


In this work we consider how users can use body movement for remote control with minimal effort and maximum flexibility. TraceMatch is a novel technique where the interface displays available controls as circular widgets with orbiting targets, and where users can trigger a control by mimicking the displayed motion. The technique uses computer vision to detect circular motion as a uniform type of input, but is highly appropriable as users can produce matching motion with any part of their body. We present three studies that investigate input performance with different parts of the body, user preferences, and spontaneous choice of movements for input in realistic application scenarios. The results show that users can provide effective input with their head, hands and while holding objects, that multiple controls can be effectively distinguished by the difference in presented phase and direction of movement, and that users choose and switch modes of input seamlessly.

Publisher page | Download (PDF)