A Multimodal Interaction Framework for Blended Learning
Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2017, Vol 4, Issue 10
Abstract
Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment and introduces a unified and effective framework for multimodal interaction called COALS.
Authors and Affiliations
N. Vidakis
Keywords
Related Articles
- EP ID EP45867
- DOI http://dx.doi.org/10.4108/eai.4-9-2017.153057
- Views 305
- Downloads 0
Establishing Interaction between Machine and Medaka using Deep Q-Network
Social interaction is the basic ability for animals to survive. It is difficult for a machine to interact with human or other animals because it is not clear how the machine should interact. This paper examines whether a...
Exploring avatar roles for motivational effects in gameful environments
This paper explores avatar roles and design principles in helping to develop motivation in game environments. Different avatar applications could influence the experience of players in at least three ways: as a customisa...
Interactive Installations for Spatial Access to Artistic Sketchbooks
A book is a book – or is it? With present-day, a ordable technology, we can scale a book to become a spatial object, or even a space in itself, of almost arbitrary size. We describe our design of and experiences with a g...
Solitude or co-existence – or learning-together-apart with digital dialogic technologies for kids with developmental and attention difficulties
An overall political vision of a prosperous society is one in which everyone has the same access and possibilities of participating in democratic processes, and in which everyone has equal access to the resources, life a...
Maze and Mirror Game Design for Increasing Motivation in Studying Science in Elementary School Students
The research project discussed here, examines attempts to increase the motivation of elementary school students in basic science by the means of designing a science game. To realize this goal, the maze and mirror game wa...