Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors

Abstract

Albanian Sign Language (AlbSL) is relatively new and until now there doesn’t exist a system that is able to recognize Albanian signs by using natural user interfaces (NUI). The aim of this paper is to present a real-time gesture recognition system that is able to automatically recognize number signs for Albanian Sign Language, captured from signer’s both hands. Kinect device is used to obtain data streams. Every pixel generated from Kinect device contains depth data information which is used to construct a depth map. Hands segmentation process is performed by applying a threshold constant to depth map. In order to differentiate signer’s hands a K-means clustering algorithm is applied to partition pixels into two groups corresponding to each signer’s hands. Centroid distance function is calculated in each hand after extracting hand’s contour pixels. Fourier descrip-tors, derived form centroid distance is used as a hand shape representation. For each number gesture there are 15 Fourier descriptors coefficients generated which represent uniquely that gesture. Every input data is compared against training data set by calculating Euclidean distance, using Fourier coefficients. Sign with the lowest Euclidean distance is considered as a match. The system is able to recognize number signs captured from one hand or both hands. When both signer’s hands are used, some of the methodology processes are executed in parallel in order to improve the overall performance. The proposed system achieves an accuracy of 91% and is able to process 55 frames per second.

Authors and Affiliations

Eriglen Gani, Alda Kika

Keywords

Related Articles

A Novel Algorithm for Optimizing Multiple Services Resource Allocation

Resource provisioning becomes more and more challenging problem in cloud computing environment since cloudbased services become more numerous and dynamic. The problem of scheduling multiple tasks for multiple users on a...

Automatic Recognition of Medicinal Plants using Machine Learning Techniques

The proper identification of plant species has major benefits for a wide range of stakeholders ranging from forestry services, botanists, taxonomists, physicians, pharmaceutical laboratories, organisations fighting for e...

Novel Carrier based PWM Techniques Reduce Common Mode Voltage for Six Phase Induction Motor Drives

This paper proposes a novel pulse width modulation (CBPWM) technique for reducing the common mode voltage for a six-phase induction motor (SPIM) drive. This proposed CBPWM technique relies on setting up offset functions...

An Extended Consistent Fuzzy Preference Relation to Evaluating Website Usability

In the current era, website developers recognize usability evaluation as a significant factor in the quality and success of e-commerce websites. Fuzzy Analytical Hierarchy Process (FAHP) is one method to measure the usab...

Framework for Assessing Privacy of Internet Applications

This paper presents a new framework for assessing and documenting the privacy risks associated with developing and managing internet applications. The Framework for Assessing Privacy of Internet Applications (FAPIA) prov...

Download PDF file
  • EP ID EP154346
  • DOI 10.14569/IJACSA.2016.070729
  • Views 132
  • Downloads 0

How To Cite

Eriglen Gani, Alda Kika (2016). Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect Sensors. International Journal of Advanced Computer Science & Applications, 7(7), 216-220. https://europub.co.uk/articles/-A-154346