Hybrid Deep Network and Polar Transformation Features for Static Hand Gesture Recognition in Depth Data

Abstract

Static hand gesture recognition is an interesting and challenging problem in computer vision. It is considered a significant component of Human Computer Interaction and it has attracted many research efforts from the computer vision community in recent decades for its high potential applications, such as game interaction and sign language recognition. With the recent advent of the cost-effective Kinect, depth cameras have received a great deal of attention from researchers. It promoted interest within the vision and robotics community for its broad applications. In this paper, we propose the effective hand segmentation from the full depth image that is important step before extracting the features to represent for hand gesture. We also represent the novel hand descriptor explicitly encodes the shape and appearance information from depth maps that are significant characteristics for static hand gestures. We propose hand descriptor based on Polar Transformation coordinate is called Histogram of Polar Transformation (HPT) in order to capture both shape and appearance. Beside a robust hand descriptor, a robust classification model also plays a very important role in the hand recognition model. In order to have a high performance in recognition rate, we propose hybrid model for classification based on Sparse Auto-encoder and Deep Neural Network. We demonstrate large improvements over the state-of-the-art methods on two challenging benchmark datasets are NTU Hand Digits and ASL Finger Spelling and achieve the overall accuracy as 97.7% and 84.58%, respectively. Our experiments show that the proposed method significantly outperforms state-of-the-art techniques.

Authors and Affiliations

Vo Viet, Tran Son, Ly Ngoc

Keywords

Related Articles

Thermal Pain Level Estimation Method with Heart Rate and Cerebral Blood Flow

Method for thermal pain level estimation with heart rate and cerebral blood flow using SVM is proposed. Through experiments, it is found that thermal pain level is much sensitive to the cerebral blood flow rather than he...

A Traffic Congestion Framework for Smart Riyadh City based on IoT Services

Internet of Things (IoT) has become one of the most challenging issues in many researches to connect physical things through the internet by creating a virtual identity for everything. Traffic congestion in Riyadh city i...

Universal Simplest possible PLC using Personal Computer

Need of industrial automation and control is not closed yet. PLC, the programmable logic controller as available in 2009 with all standardized possible features, discussed here concisely. This work on PLC gives a simples...

Real-Time H.264/AVC Entropy Encoder Hardware Architecture in Baseline Profile

In this paper, we present a new hardware architecture of an entropy encoder for an H.264/AVC video encoder. The proposed design aims to employ a parallel module at a pre-encoding stage to reduce a critical path. Addition...

An AHP Model towards an Agile Enterprise

Companies are facing different challenges in order to adapt to their environmental context. They should be aware of the changes on the social, political, ecological and economical levels. Moreover, they should act in an...

Download PDF file
  • EP ID EP128440
  • DOI 10.14569/IJACSA.2016.070536
  • Views 107
  • Downloads 0

How To Cite

Vo Viet, Tran Son, Ly Ngoc (2016). Hybrid Deep Network and Polar Transformation Features for Static Hand Gesture Recognition in Depth Data. International Journal of Advanced Computer Science & Applications, 7(5), 255-263. https://europub.co.uk/articles/-A-128440