Recognition of American Sign Language Fingerspelling by Applying Matrix Matching Algorithm Using Leap Motion Controller Sensor

Abstract

This paper presents the recognition of American Sign Language Fingerspelling by applying Matrix Matching algorithm using Leap Motion Controller Sensor. The study focused on the recognition of all the static and dynamic letters to increase the recognition rate and avoid misclassification. With proper hand orientation of the user and using the Leap Motion Controller Sensor’s skeletal tracking feature, the researchers were able to acquire the joint coordinates of the distal and proximal phalanges of the human hand. These acquired joint coordinates were then used to create two matrices where matrix multiplication was then applied to generate a unique output matrix. Reduction of row elements as well as the column elements were used by the researchers to derive the Horizontal and Vertical resultant matrices to uniquely represent the letters in American Sign Language Fingerspelling. The letters would then be recognized by the system once the generated resultant matrix matched the reference resultant matrix in the system program. The process of matrix subtraction was executed in the matching process of the algorithm.

Authors and Affiliations

Aljhon N. Abila, Rafael Joseph C. Dichoso, Reditt John B. Rance, Jhon Nathaniel M. Umali, Ralph Anthony Yanza

Keywords

Related Articles

Study of SWT-ANN Based Indoor Optical Wireless Communication System: A Review

This paper reviews on optical wireless system using stationary wavelet and neural network. High-speed wireless optical communication links have become more popular for personal mobile applications. This is a consequence...

Evaluation of Electrical and Mechanical Properties of Particulate Filled Natural Fiber Reinforced Vinyl ester Composites

Globally natural fiber based structured polymer composite materials are emerging material of various disciplinary. In general the natural fiber composites are low cost, no health hazard, electrical insulation, good mech...

Comparative Parameter of Stone Dust as a Replacement Material of Sand

In this we are investigating the comparative parameter for stone dust as a replacement material of sand .The whole study is mainly done only for replacement material of sand by stone dust which is used in mortar. Stone...

Load Balanced Geographic Routing In Wireless Sensor Networks

A wireless sensor network (WSN) is used to monitor environmental conditions, such as sound, pressure, temperature etc. and to simultaneously share their data via the network to the destination. They are enabling control...

Enhanced Architecture Design for Social Media, ECommerce and News Using Advanced Micro Blogging Information

To interconnecting three various servers like, social network, E-commerce application and news channels to develop an enhanced web application. Also enhanced micro blogging information has been implemented for efficient...

Download PDF file
  • EP ID EP23241
  • DOI http://doi.org/10.22214/ijraset.2017.3044
  • Views 352
  • Downloads 8

How To Cite

Aljhon N. Abila, Rafael Joseph C. Dichoso, Reditt John B. Rance, Jhon Nathaniel M. Umali, Ralph Anthony Yanza (2017). Recognition of American Sign Language Fingerspelling by Applying Matrix Matching Algorithm Using Leap Motion Controller Sensor. International Journal for Research in Applied Science and Engineering Technology (IJRASET), 5(3), -. https://europub.co.uk/articles/-A-23241