Recognition of American Sign Language Fingerspelling by Applying Matrix Matching Algorithm Using Leap Motion Controller Sensor

Abstract

This paper presents the recognition of American Sign Language Fingerspelling by applying Matrix Matching algorithm using Leap Motion Controller Sensor. The study focused on the recognition of all the static and dynamic letters to increase the recognition rate and avoid misclassification. With proper hand orientation of the user and using the Leap Motion Controller Sensor’s skeletal tracking feature, the researchers were able to acquire the joint coordinates of the distal and proximal phalanges of the human hand. These acquired joint coordinates were then used to create two matrices where matrix multiplication was then applied to generate a unique output matrix. Reduction of row elements as well as the column elements were used by the researchers to derive the Horizontal and Vertical resultant matrices to uniquely represent the letters in American Sign Language Fingerspelling. The letters would then be recognized by the system once the generated resultant matrix matched the reference resultant matrix in the system program. The process of matrix subtraction was executed in the matching process of the algorithm.

Authors and Affiliations

Aljhon N. Abila, Rafael Joseph C. Dichoso, Reditt John B. Rance, Jhon Nathaniel M. Umali, Ralph Anthony Yanza

Keywords

Related Articles

Application Based Multimodal Biometric System for Speech Controlled Device

Multimodal biometric systems have been widely used to overcome the limitations of unimodal biometric systems and to achieve high recognition accuracy. Unimodal biometric systems developed for each of the biometric featu...

Engine Performance and Emission Characteristics of a Single Cylinder Four Stroke CI Engine on Dual Fuel Mode by Using Compressed Biogas as a Fuel

Conventional fuels like diesel and petrol are depleting day by day, so we have to search for an alternative fuel. The aim of study is to analyze the performance and emission characteristics existing single cylinder four...

Smart City – The Urban Intelligence of India

Smart City means aligning information technologies to citizens’ needs in order to enhance their day-to-day lives by increasing efficiency, lowering costs, and engaging more directly with city dwellers. Developing a smar...

Enhanced Twitter Sentiment Analysis by using Open NLP with Positive Negative and Neutral Tweet

Due to the vast opinion of rich web resources such as discussion forum, review sites , blogs and news corpora on the market in digital form, a lot of analysis is focusing on the area of sentiment analysis. People are tr...

Analysis and Experimentation of Shell and Tube Heat Exchanger with Different Orientation of Baffles

An Experimentation along with CFD analysis is carried on single pass, counter flow shell and tube heat exchanger containing Baffles at 00,150,300,450 orientation. To study the heat transfer rate and pressure drop of she...

Download PDF file
  • EP ID EP23241
  • DOI http://doi.org/10.22214/ijraset.2017.3044
  • Views 340
  • Downloads 8

How To Cite

Aljhon N. Abila, Rafael Joseph C. Dichoso, Reditt John B. Rance, Jhon Nathaniel M. Umali, Ralph Anthony Yanza (2017). Recognition of American Sign Language Fingerspelling by Applying Matrix Matching Algorithm Using Leap Motion Controller Sensor. International Journal for Research in Applied Science and Engineering Technology (IJRASET), 5(3), -. https://europub.co.uk/articles/-A-23241