Gestures Recognition from Sound Waves

Abstract

We propose a new method to recognize gestures from sound waves. The main contribution of this paper is to recognize gestures based on the analysis of short-time Fourier transforms (STFT) using the Doppler effect to sense gestures. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. Experimenting method and evaluating results by using the hand gestures of many different people to browse applications such as website, document and images in the browser on the computers in the classroom and library environment for accurate results. In addition, we describe the phenomena and recognition algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across Laptop device and people.

Authors and Affiliations

Nguyen Dang Binh

Keywords

Related Articles

FoCAS Project's Interview with Dr. Phan Cong Vinh, ICCASA 2013 General Chair

Dr. Phan Cong Vinh, Nguyen Tat Thanh University in Vietnam, General Chair of the 2nd International Conference on Context-Aware Systems and Applications (ICCASA 2013) shares with Prof. Giacomo Cabri, a FoCAS project's...

Representing and Reasoning with the Internet of Things: a Modular Rule-Based Model for Ensembles of Context-Aware Smart Things

Context-aware smart things are capable of computational behaviour based on sensing the physical world, inferring context from the sensed data, and acting on the sensed context. A collection of such things can form what w...

Synchronous networks for bio-environmental surveillance based on cellular automata

The paper proposes a new approach to model a bio-environmental surveillance network as synchronous network systems, systems consist of components running simultaneously. In the network, bio-environmental factors compose...

Context-aware approach for formal verification

The Context-aware approach has proven to be an effective technique for software model-checking verification. It focuses on the explicit modelling of environment as one or more contexts. In this area, specifying precise r...

Modified Virtual Air Guitar: A Concept Realized using Image Processing Techniques

Even amidst the hustle and bustle of busy lives, numerous people dream of playing a musical instrument. Unfortunately, many may never get a chance to touch one. But this doesn’t stop them from ‘air drumming’ or playing ‘...

Download PDF file
  • EP ID EP45787
  • DOI http://dx.doi.org/10.4108/eai.12-9-2016.151679
  • Views 283
  • Downloads 0

How To Cite

Nguyen Dang Binh (2016). Gestures Recognition from Sound Waves. EAI Endorsed Transactions on Context-aware Systems and Applications, 3(10), -. https://europub.co.uk/articles/-A-45787