Hidden Markov Model for recognition of skeletal databased hand movement gestures

Abstract

The development of computing technology provides more and more methods for human-computer interaction applications. The gesture or motion of a human hand is considered as one of the most basic communications for interacting between people and computers. Recently, the release of 3D cameras such as Microsoft Kinect and Leap Motion has provided many advantage tools to explore computer vision and virtual reality based on RGB-Depth images. The paper focuses on improving approach for detecting, training, and recognizing the state sequences of hand motions automatically. The hand movements of three persons are recorded as the input of a recognition system. These hand movements correspond to five actions: sweeping right to left, sweeping top to bottom, circle motion, square motion, and triangle motion. The skeletal data of hand joint are collected to build an observation database. Desired features of each hand action are extracted from skeleton video frames by using the Principle Component Analysis (PCA) algorithm for training and recognition. A hidden Markov model (HMM) is applied to train the feature data and recognize various states of hand movements. The experimental results showed that the proposed method achieved the average accuracy nearly 95.66% and 91.00% for offline and online recognition, respectively.

Authors and Affiliations

Bui Cong Giao, Trinh Hoai An, Nguyen Thi Hong Anh, Ho Nhut Minh

Keywords

Related Articles

To Sense or not to Sense: An Exploratory Study of Privacy, Trust and other related concerns in Personal Sensing Context-aware Applications

Due to increasing proliferation of smart devices, many users store a significant proportion of personal data on them. Thus, personal sensing applications that sense a user’s context via his smart device have significant...

Hidden Markov Model for recognition of skeletal databased hand movement gestures

The development of computing technology provides more and more methods for human-computer interaction applications. The gesture or motion of a human hand is considered as one of the most basic communications for interact...

Face recognition based on LDA in manifold subspace

Although LDA has many successes in dimensionality reduction and data separation, it also has disadvantages, especially the small sample size problem in training data because the "within-class scatter" matrix may not be a...

Context-based Project Management

Context-based computing has become an integral part of the software infrastructure of modern society. Better software are made adaptive to suit the surrounding environment. Context-based applications best fit into enviro...

A Variable Neighborhood Search Algorithm for Solving the Steiner Minimal Tree Problem in Sparse Graphs

Steiner Minimal Tree (SMT) is a complex optimization problem that has many important applications in science and technology; This is a NP-hard problem. Much research has been carried out to solve the SMT problem using ap...

Download PDF file
  • EP ID EP45803
  • DOI http://dx.doi.org/10.4108/eai.18-6-2018.154819
  • Views 307
  • Downloads 0

How To Cite

Bui Cong Giao, Trinh Hoai An, Nguyen Thi Hong Anh, Ho Nhut Minh (2017). Hidden Markov Model for recognition of skeletal databased hand movement gestures. EAI Endorsed Transactions on Context-aware Systems and Applications, 4(14), -. https://europub.co.uk/articles/-A-45803