A System for Multimodal Interaction with Kinect-Enabled Virtual Windows

Journal Title: EAI Endorsed Transactions on Collaborative Computing - Year 2015, Vol 1, Issue 3

Abstract

Commercial off-the-shelf gaming devices (e.g. such as Kinect) are demonstrating to have a great potential beyond their initial service purpose. In particular, when integrated within the environment or as part of smart objects, peripheral COTS for gaming may facilitate the definition of novel interaction methods, particularly applicable to smart spaces service concepts. In this direction, this paper describes a system prototype that makes possible to deliver multimodal interaction with the media contents in a Virtual Window. Using a Kinect device, the Interactive Window itself adjusts the video clipping to the real time perspective of the user – who can freely move within the sensor coverage are. On the clipped video, the user is able to select objects by pointing at meaningful image sections and to initiate actions related to them. Voice orders may also complete the interaction when necessary. Although implemented for smart spaces, the service concept can also be applied to learning, remote control processes or teleconference.

Authors and Affiliations

Ana M. Bernardos, Íñigo Marquínez, David Gómez, Juan Besada, José Casar

Keywords

Related Articles

Harnessing Context for Vandalism Detection in Wikipedia

The importance of collaborative social media (CSM) applications such as Wikipedia to modern free societies can hardly be overemphasized. By allowing end users to freely create and edit content, Wikipedia has greatly faci...

A Highly Concurrent Replicated Data Structure EAI Endorsed Transactions

Well defined concurrent replicated data structure is very important to design collaborative editing system, particularly, certain properties like out-of-order execution of concurrent operations and data convergence. In t...

Testing Software Using Swarm Intelligence: A Bee Colony Optimization Approach

Software testing is a critical activity in increasing our confidence of a system under test and improving its quality. The key idea for testing a software application is to minimize the number of faults found in the syst...

Impact on procurement and training by research on the interaction design of medical devices

We present a case study of how research can influence practice in the procurement of healthcare technology based on the CHI+MED project. CHI+MED is concerned with interaction design and the safety of medical devices. It...

Automated Dimension Determination for NMF-based Incremental Collaborative Filtering

The nonnegative matrix factorization (NMF) based collaborative filtering t e chniques h a ve a c hieved great success in product recommendations. It is well known that in NMF, the dimensions of the factor matrices have t...

Download PDF file
  • EP ID EP45690
  • DOI http://dx.doi.org/10.4108/icst.intetain.2015.259498
  • Views 254
  • Downloads 0

How To Cite

Ana M. Bernardos, Íñigo Marquínez, David Gómez, Juan Besada, José Casar (2015). A System for Multimodal Interaction with Kinect-Enabled Virtual Windows. EAI Endorsed Transactions on Collaborative Computing, 1(3), -. https://europub.co.uk/articles/-A-45690