Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations
Journal Title: Informatics - Year 2018, Vol 5, Issue 4
Abstract
Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual environments. However, accurately simulating the sense of touch is difficult, requiring the use of high-fidelity haptic devices that are cost-prohibitive. Lower fidelity consumer-level haptic devices are becoming more widespread, yet are generally limited in perceived fidelity and the range of motion (degrees of freedom) required to realistically simulate many tasks. Studies into sound and vision suggest that the presence or absence of sound can influence task performance. Here, we explore whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task. Although the results of this study do not show any statistically significant difference in task performance with general (task-irrelevant) sound, we discuss how this is a necessary step in understanding the role of sound on haptic perception.
Authors and Affiliations
Mohammed Melaisi, David Rojas, Bill Kapralos, Alvaro Uribe-Quevedo and Karen Collins
Keywords
Related Articles
- EP ID EP44157
- DOI https://doi.org/10.3390/informatics5040043
- Views 253
- Downloads 0
Creating a Multimodal Translation Tool and Testing Machine Translation Integration Using Touch and Voice
Commercial software tools for translation have, until now, been based on the traditional input modes of keyboard and mouse, latterly with a small amount of speech recognition input becoming popular. In order to test wh...
The Effects of Motion Artifacts on Self-Avatar Agency
One way of achieving self-agency in virtual environments is by using a motion capture system and retargeting user’s motion to the virtual avatar. In this study, we investigated whether the self-agency is affected when mo...
Constructing Interactive Visual Classification, Clustering and Dimension Reduction Models for n-D Data
The exploration of multidimensional datasets of all possible sizes and dimensions is a long-standing challenge in knowledge discovery, machine learning, and visualization. While multiple efficient visualization methods...
How Thumbelina Knows
In this paper, I take the book by Michel Serres, “Thumbelina”, as an occasion for reflection on the conceptual basis of knowledge management, as was built by Nonaka and co-workers. The direct access to knowledge that T...
Conceptualization and Non-Relational Implementation of Ontological and Epistemic Vagueness of Information in Digital Humanities
Research in the digital humanities often involves vague information, either because our objects of study lack clearly defined boundaries, or because our knowledge about them is incomplete or hypothetical, which is especi...