Comparing elicited gestures to designer-created gestures for selection above a multitouch surface

Full-length conference paper, ITS 2012

Abstract

Many new technologies are emerging that make it possible to extend interaction into the three-dimensional space directly above or in front of a multitouch surface. Such techniques allow people to control these devices by performing hand gestures in the air. In this paper, we present a method of extending interactions into the space above a multitouch surface using only a standard diffused surface illumination (DSI) device, without any additional sensors. Then we focus on interaction techniques for activating graphical widgets located in this above-surface space. We have conducted a study to elicit gestures for above-table widget activation. A follow-up study was conducted to evaluate and compare these gestures based on their performance. Our results showed that there was no clear agreement on what gestures should be used to select objects in mid-air, and that performance was better when using gestures that were chosen less frequently, but predicted to be better by the designers, as opposed to those most frequently suggested by participants.

Paper

Dmitry Pyryeskin, Mark Hancock, and Jesse Hoey. Comparing elicited gestures to designer-created gestures for selection above a multitouch surface. In Proc. ITS, pp. 1-10, 2012.

DOI: 10.1145/2396636.2396638

Bibtex Entry

@inproceedings{Pyryeskin:2012:CEG:2396636.2396638,
    author = {Pyryeskin, Dmitry and Hancock, Mark and Hoey, Jesse},
    title = {Comparing elicited gestures to designer-created gestures for selection above a multitouch surface},
    booktitle = {Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces},
    series = {ITS '12},
    year = {2012},
    isbn = {978-1-4503-1209-7},
    location = {Cambridge, Massachusetts, USA},
    pages = {1--10},
    numpages = {10},
    url = {http://doi.acm.org/10.1145/2396636.2396638},
    doi = {10.1145/2396636.2396638},
    acmid = {2396638},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {gestures, hoverspace, multimodal interaction, multitouch, natural human computer interaction, surface computing},
}