Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors

Abstract

Albanian Sign Language (AlbSL) is relatively new and until now there doesn’t exist a system that is able to recognize Albanian signs by using natural user interfaces (NUI). The aim of this paper is to present a real-time gesture recognition system that is able to automatically recognize number signs for Albanian Sign Language, captured from signer’s both hands. Kinect device is used to obtain data streams. Every pixel generated from Kinect device contains depth data information which is used to construct a depth map. Hands segmentation process is performed by applying a threshold constant to depth map. In order to differentiate signer’s hands a K-means clustering algorithm is applied to partition pixels into two groups corresponding to each signer’s hands. Centroid distance function is calculated in each hand after extracting hand’s contour pixels. Fourier descrip-tors, derived form centroid distance is used as a hand shape representation. For each number gesture there are 15 Fourier descriptors coefficients generated which represent uniquely that gesture. Every input data is compared against training data set by calculating Euclidean distance, using Fourier coefficients. Sign with the lowest Euclidean distance is considered as a match. The system is able to recognize number signs captured from one hand or both hands. When both signer’s hands are used, some of the methodology processes are executed in parallel in order to improve the overall performance. The proposed system achieves an accuracy of 91% and is able to process 55 frames per second.

Authors and Affiliations

Eriglen Gani, Alda Kika

Keywords

Related Articles

A Nested Genetic Algorithm for Mobile Ad-Hoc Network Optimization with Fuzzy Fitness

One of the major culprits that faces Mobile Ad-hoc networks (MANET) is broadcasting, which constitutes a very important part of the infrastructure of such networks. This paper presents a nested genetic algorithm (GA) tec...

Image Stitching System Based on ORB Feature-Based Technique and Compensation Blending 

The construction of a high-resolution panoramic image from a sequence of input overlapping images of the same scene is called image stitching/mosaicing. It is considered as an important, challenging topic in computer vis...

Stylometric Techniques for Multiple Author Clustering

In 1598-99 printer, William Jaggard named Shakespeare as the sole author of The Passionate Pilgrim even though Jaggard chose a number of non-Shakespearian poems in the volume. Using a neurolinguistics approach to authors...

Agile Methods Selection Model: A Grounded Theory Study

Agile methods adoption has increased in recent years because of its contribution to the success rate of project development. Nevertheless, the success rate of projects implemented using Agile methods has not completely r...

Development Process Patterns for Distributed Onshore/Offshore Software Projects

The globalisation of the commercial world, and the use of distributed working practices (Offshore/ onshore/ near-shore) has increased dramatically with the improvement of information and communication technologies. Many...

Download PDF file
  • EP ID EP154346
  • DOI 10.14569/IJACSA.2016.070729
  • Views 131
  • Downloads 0

How To Cite

Eriglen Gani, Alda Kika (2016). Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors. International Journal of Advanced Computer Science & Applications, 7(7), 216-220. https://europub.co.uk/articles/-A-154346