Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem
Journal Title: Informatics - Year 2019, Vol 6, Issue 2
Abstract
If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devices and a total of 55 referents (commands for device) that can be grouped to 14 commands (that refer to more than one device). The elicitation study was conducted in a frame (general scenario) of use of all devices to support contextual relevance; also, the referents were presented with minimal affordances to minimize widget-specific proposals. In addition to computing agreement rates for all referents, we also computed the internal consistency of user proposals (single-user agreement for multiple commands). In all, 1047 gestures from 18 participants were recorded, analyzed, and paired with think-aloud data. The study reached to a mid-air gesture vocabulary for a smart-device ecosystem, which includes several gestures with very high, high and medium agreement rates. Furthermore, there was high consistency within most of the single-user gesture proposals, which reveals that each user developed and applied her/his own mental model about the whole set of interactions with the device ecosystem. Thus, we suggest that mid-air interaction support for smart homes should not only offer a built-in gesture set but also provide for functions of identification and definition of personalized gesture assignments to basic user commands.
Authors and Affiliations
Panagiotis Vogiatzidakis and Panayiotis Koutsabasis
Keywords
Related Articles
- EP ID EP44176
- DOI https://doi.org/10.3390/informatics6020023
- Views 288
- Downloads 0
Preparation for Working in a Knowledge-Based Society: New Zealand Student Nurses’ Use of Social Media
The increasing use of social media is revolutionizing the way students learn, communicate and collaborate. Many of the skills used with social media are similar to those needed to work in a knowledge-based society. To...
Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions
Making sense of complex objects is difficult, and typically requires the use of external representations to support cognitive demands while reasoning about the objects. Visualizations are one type of external representat...
Understanding the EMR-Related Experiences of Pregnant Japanese Women to Redesign Antenatal Care EMR Systems
Woman-centered antenatal care necessitates Electronic Medical Record (EMR) systems that respect women’s preferences. However, women’s preferences regarding EMR systems in antenatal care remain unknown. This work aims t...
A Smart Sensor Data Transmission Technique for Logistics and Intelligent Transportation Systems
When it comes to Internet of Things systems that include both a logistics system and an intelligent transportation system, a smart sensor is one of the key elements to collect useful information whenever and wherever n...
Identifying Opportunities to Integrate Digital Professionalism into Curriculum: A Comparison of Social Media Use by Health Profession Students at an Australian University in 2013 and 2016
Social media has become ubiquitous to modern life. Consequently, embedding digital professionalism into undergraduate health profession courses is now imperative and augmenting learning and teaching with mobile technol...