A Multimodal Interaction Framework for Blended Learning
Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2017, Vol 4, Issue 10
Abstract
Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment and introduces a unified and effective framework for multimodal interaction called COALS.
Authors and Affiliations
N. Vidakis
Keywords
Related Articles
- EP ID EP45867
- DOI http://dx.doi.org/10.4108/eai.4-9-2017.153057
- Views 341
- Downloads 0
Emotional interactive movie: adjusting the scenario according to the emotional response of the viewer
Emotional interactive movie is a kind of film unfolding in different ways according to the emotion the viewer experiences. The movie is made of several sequences; their combination determines the particular scenario expe...
Templates as heuristics for proving properties of medical devices
This paper briefly describes how property templates have been used to analyse and explore the interactive behaviour of a specific medical device (an IV infusion pump). It is proposed that interactive devices that satisfy...
Contextual Design of ICT for Physiotherapy: Toward Knowledge and Innovation Ecosystem
With advances in information and communication technologies (ICT), changes have been produced in physiotherapy provision. However, low adoption of the new technologies calls attention for better theoretical model and met...
Using Video Analysis and Machine Learning for Predicting Shot Success in Table Tennis
Coaching professional ball players has become more and more dicult and requires among other abilities also good tactical knowledge. This paper describes a program that can assist in tactical coaching for table tennis by...
The Significance of a Body in Contemporary Arts
This paper discusses the role and significance of a body in Performance Art. Considering that Art reflects social, cultural and sometimes political realities, we identify types of messages that an artwork using advanced...