Beating-Time Gestures Imitation Learning for Humanoid Robots

Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2017, Vol 4, Issue 13

Abstract

Beating-time gestures are movement patterns of the hand swaying along with music, thereby indicating accented musical pulses. The spatiotemporal configuration of these patterns makes it diÿcult to analyse and model them. In this paper we present an innovative modelling approach that is based upon imitation learning or Programming by Demonstration (PbD). Our approach - based on Dirichlet Process Mixture Models, Hidden Markov Models, Dynamic Time Warping, and non-uniform cubic spline regression - is particularly innovative as it handles spatial and temporal variability by the generation of a generalised trajectory from a set of periodically repeated movements. Although not within the scope of our study, our procedures may be implemented for the sake of controlling movement behaviour of robots and avatar animations in response to music.

Authors and Affiliations

Denis Amelynck, Pieter-Jan Maes, Jean-Pierre Martens, Marc Leman

Keywords

Related Articles

Interactive Installations for Spatial Access to Artistic Sketchbooks

A book is a book – or is it? With present-day, a ordable technology, we can scale a book to become a spatial object, or even a space in itself, of almost arbitrary size. We describe our design of and experiences with a g...

CITE – Content Interaction Time and spacE: a hybrid approach to model man-robot interaction for deployment in museums

In this paper , we present a generic model, CITE (Conten t-Interaction- Time-spacE) devoted to the development of interactive applications for places of culture such as museums or theaters. The idea is to introduce new k...

Varianish: Jamming with Pattern Repetition

In music, patterns and pattern repetition are often regarded as a machine-like task, indeed often delegated to drum Machines and sequencers. Nevertheless, human players add subtle differences and variations to repeated p...

Designing for learning and empowerment: how designbased research can impact education and practice

This paper proposes design-based research as a teaching approach to enhance the learning environment of university college students and as a potential tool for empowerment in practice. The paper depicts how students, pro...

QoE-Aware Device-to-Device Multimedia Communications

Multimedia services over mobile device-to-device (D2D) networks has recently received considerable attention. In this scenario, each device is equipped with a cellular communication interface, as well as a D2D interface...

Download PDF file
  • EP ID EP45882
  • DOI http://dx.doi.org/10.4108/eai.8-11-2017.153335
  • Views 265
  • Downloads 0

How To Cite

Denis Amelynck, Pieter-Jan Maes, Jean-Pierre Martens, Marc Leman (2017). Beating-Time Gestures Imitation Learning for Humanoid Robots. EAI Endorsed Transactions on Creative Technologies, 4(13), -. https://europub.co.uk/articles/-A-45882