Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors

Abstract

Albanian Sign Language (AlbSL) is relatively new and until now there doesn’t exist a system that is able to recognize Albanian signs by using natural user interfaces (NUI). The aim of this paper is to present a real-time gesture recognition system that is able to automatically recognize number signs for Albanian Sign Language, captured from signer’s both hands. Kinect device is used to obtain data streams. Every pixel generated from Kinect device contains depth data information which is used to construct a depth map. Hands segmentation process is performed by applying a threshold constant to depth map. In order to differentiate signer’s hands a K-means clustering algorithm is applied to partition pixels into two groups corresponding to each signer’s hands. Centroid distance function is calculated in each hand after extracting hand’s contour pixels. Fourier descrip-tors, derived form centroid distance is used as a hand shape representation. For each number gesture there are 15 Fourier descriptors coefficients generated which represent uniquely that gesture. Every input data is compared against training data set by calculating Euclidean distance, using Fourier coefficients. Sign with the lowest Euclidean distance is considered as a match. The system is able to recognize number signs captured from one hand or both hands. When both signer’s hands are used, some of the methodology processes are executed in parallel in order to improve the overall performance. The proposed system achieves an accuracy of 91% and is able to process 55 frames per second.

Authors and Affiliations

Eriglen Gani, Alda Kika

Keywords

Related Articles

Issues Elicitation and Analysis of CMMI Based Process Improvement in Developing Countries Theory and Practice

Researchers have tried to find out the pattern of rising and fall of Pakistani software industry and also the reasons for what is going exactly wrong with this industry. Different studies have witnessed that in Pakistan,...

Evaluating Damage Potential in Security Risk Scoring Models

A Continuous Monitoring System (CMS) model is presented, having new improved capabilities. The system is based on the actual real-time configuration of the system. Existing risk scoring models assume damage potential is...

Multimodal Automatic Image Annotation Method using Association Rules Mining and Clustering

Effective and fast retrieval of images from image datasets is not an easy task, especially with the continuous and fast growth of digital images added everyday by used to the web. Automatic image annotation is an approac...

A Novel Method for Measuring the Performance of Software Project Managers

This paper is focused on providing a novel method for measuring the performance of software project managers. It clarifies the fundamental concepts of software project management, knowledge areas, life cycle phases of so...

Methodology for Selecting the Preferred Networked Computer System Solution for Dynamic Continuous Defense Missions

This paper presents a methodology for addressing the challenges and opportunities in defining and selecting the preferred Networked Computer System (NCS) solution in response to specified United States Defense mission pl...

Download PDF file
  • EP ID EP154346
  • DOI 10.14569/IJACSA.2016.070729
  • Views 129
  • Downloads 0

How To Cite

Eriglen Gani, Alda Kika (2016). Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors. International Journal of Advanced Computer Science & Applications, 7(7), 216-220. https://europub.co.uk/articles/-A-154346