Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations
Journal Title: Informatics - Year 2018, Vol 5, Issue 4
Abstract
Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual environments. However, accurately simulating the sense of touch is difficult, requiring the use of high-fidelity haptic devices that are cost-prohibitive. Lower fidelity consumer-level haptic devices are becoming more widespread, yet are generally limited in perceived fidelity and the range of motion (degrees of freedom) required to realistically simulate many tasks. Studies into sound and vision suggest that the presence or absence of sound can influence task performance. Here, we explore whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task. Although the results of this study do not show any statistically significant difference in task performance with general (task-irrelevant) sound, we discuss how this is a necessary step in understanding the role of sound on haptic perception.
Authors and Affiliations
Mohammed Melaisi, David Rojas, Bill Kapralos, Alvaro Uribe-Quevedo and Karen Collins
Keywords
Related Articles
- EP ID EP44157
- DOI https://doi.org/10.3390/informatics5040043
- Views 260
- Downloads 0
Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations
Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual envi...
Creating a Multimodal Translation Tool and Testing Machine Translation Integration Using Touch and Voice
Commercial software tools for translation have, until now, been based on the traditional input modes of keyboard and mouse, latterly with a small amount of speech recognition input becoming popular. In order to test wh...
Reinforcement Learning for Predictive Analytics in Smart Cities
The digitization of our lives cause a shift in the data production as well as in the required data management. Numerous nodes are capable of producing huge volumes of data in our everyday activities. Sensors, personal...
Human–Information Interaction with Complex Information for Decision-Making
Human–information interaction (HII) for simple information and for complex information is different because people’s goals and information needs differ between the two cases. With complex information, comprehension com...
A Comprehensive Study of Activity Recognition Using Accelerometers
This paper serves as a survey and empirical evaluation of the state-of-the-art in activity recognition methods using accelerometers. The paper is particularly focused on long-term activity recognition in real-world set...