Learnings from an Iterative Design Process for Technology-Mediated Audience Participation (TMAP) using Smartphones

Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2018, Vol 5, Issue 14

Abstract

We discuss a setup for technology-mediated audience participation (TMAP)in live music using smartphones and high-frequency sound IDs in a playful setting. The audience needs to install a smartphone app. Using high-frequency sound IDs music samples and colors can be triggered on the audience’s smartphones without the need to have an internet connection. The resulting soundscape is determined by the samples and parameters selected by the artist as well as by the location audience members choose in the performance space. We present the technical basis and iterative explorative design process of such a system for TMAP. The learnings from the perspective of musicians were technical requirements such as low latency, reliability, as well as increasing the number of possible sound samples and sound quality and we further present learnings on creating systems for TMAP from technical and creative perspectives.

Authors and Affiliations

Fares Kayali, Oliver Hodl, Christoph Bartmann, Ulrich Kuhn, Thomas Wagensommerer, Ruth Mateus-Berr

Keywords

Related Articles

Exploring Deep Recurrent Q-Learning for Navigation in a 3D Environment

Learning to navigate in 3D environments from raw sensory input is an important step towards bridging the gap between human players and artificial intelligence in digital games. Recent advances in deep reinforcement learn...

Exploring avatar roles for motivational effects in gameful environments

This paper explores avatar roles and design principles in helping to develop motivation in game environments. Different avatar applications could influence the experience of players in at least three ways: as a customisa...

A Multimodal Interaction Framework for Blended Learning

Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between hum...

Facilitating Requirements Inspection with Search-Based Selection of Diverse Use Case Scenarios

Use case scenarios are often used for conducting requirements inspection and other relevant downstream activities. While working with industrial partners, we discovered that an automated solution is required for optimall...

Dynamic Resource Allocation Scheme Using Cooperative Game for Multimedia Services in LTE Advanced System

In LTE Advanced system, it is critical to carry on various types of services for different user applications. Obviously, the system resource requirements are quite different for each individual service. In order to alloc...

Download PDF file
  • EP ID EP45888
  • DOI http://dx.doi.org/10.4108/eai.16-1-2018.153643
  • Views 299
  • Downloads 0

How To Cite

Fares Kayali, Oliver Hodl, Christoph Bartmann, Ulrich Kuhn, Thomas Wagensommerer, Ruth Mateus-Berr (2018). Learnings from an Iterative Design Process for Technology-Mediated Audience Participation (TMAP) using Smartphones. EAI Endorsed Transactions on Creative Technologies, 5(14), -. https://europub.co.uk/articles/-A-45888