Sensors for the Senses: Meaning-making via self-active entertainment experiences
Journal Title: EAI Endorsed Transactions on e-Learning - Year 2015, Vol 2, Issue 8
Abstract
In his ACM Computers in Entertainment article, titled "Artist and Audience: Emerging the Nano-entertainment experience", the author posited on how Inhabited Information Spaces, created as core catalyst of research, may be questioned as a multisensory future virtual work of art. This themed Human-Computer Interaction for Entertainment contribution for the EAI INTETAIN 2015 conference builds upon the earlier work by questioning meaning making from such self-active entertainment experiences. Contextually, self-active relates to actor empowerment via ICT, whilst entertainment refers to HCI paradigms that are fun, engaging, and enjoyable. Conceptualizing, designing and realizing alternative digital media entertainment situations in stage performance, interactive installations and exhibitions at leading Museums for Modern Art, National and International major events, contributed to development of a sensor-based system conceived as a platform to investigate meaning making having societal impact beyond art. The system involves arrays of selectable sensor profiles mixed and matched according to requirements. Sensing of human input can be through worn (biosignal e.g. EEG, ECG, EMG, GSR), held, and/or non-worn sensors (volumetric, linear and planar interface profiles). Mapping of sourced human data is to a variety of digital content including art-based (music making, digital painting, lighting effects), video games, Virtual Reality and robotic devices. System adaptability promotes participant profile matching e.g. according to desired outcome. All ages and abilities are potential users. Preceding the commonly known camera-based game controllers such as EyeToy, Wii, and Kinect; the SoundScapes Virtual Interactive Space system has been used in institutes, hospitals and clinics to empower people with impairment to unconsciously push their limits of functionality via creative and playful expression. Rehabilitation is less mundane and boring, where variety of ICT-based intervention motivates whilst offering creative opportunities for facilitators. Additionally, in a randomized intervention study with frail elderly patients, Hagedorn and Holm reported significant clinical rehabilitation impact up to 400% in the ICT feedback training specific performance. This work highlights how co-informing paradigms between computer and human science and art, games and healthcare, can result in societal impact as well as commercial patented product and industry start-ups. At the core of the research is a rethinking in the way a human interacts with ICT. Current research explores a concept of dynamic air and alternative physical-virtual environments. Conclusions introduce a suggested need of increased researcher awareness of post-research effect following intervention/trials within healthcare and rehabilitation.
Authors and Affiliations
Anthony Brooks
Animating Instructional Materials in Computer Education: An Approach to Designing and Teaching Concepts in Data Structures Using LATEX
Animation gives a different perception on what is being visually presented. Research has shown that students are likely to understand what is being taught from the combination of animation and text than just with text. S...
Digital ethnicity: discussion of a concept and implications for education
Interaction with the rapidly expanding digital technologies for education, work, and play has drastically changed the processes and practices of world populations. As societies evolve in response to these new communicati...
Automation of Algorithmic Tasks for Virtual Laboratories Based on Automata Theory.
In the work a description of an automata model of standard algorithm for constructing a correct solution of algorithmic tests is given. The described model allows a formal determination of the variant complexity of algor...
Media Usage in Post-Secondary Education and Implications for Teaching and Learning
The Web 2.0 has permeated academic life. The use of online information services in post-secondary education has led to dramatic changes in faculty teaching methods as well as in the learning and study behavior of student...
Integrating WeChat-based Mobile-Assisted Language Learning into College English Teaching
WeChat, one of the most popular social networking tools in China, has attracted attention of educators to its pedagogical value such as its support for interactivity and real-time communications. Based on the literature...