Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text

Abstract

This paper summarizes various algorithms used to design a sign language recognition system. Sign language is the language used by deaf people to communicate among themselves and with normal people. We designed a real time sign language recognition system that can recognize gestures of sign language from videos under complex backgrounds. Segmenting and tracking of non-rigid hands and head of the signer in sign language videos is achieved by using active contour models. Active contour energy minimization is done using signers hand and head skin colour, texture, boundary and shape information. Classification of signs is done by an artificial neural network using error back propagation algorithm. Each sign in the video is converted into a voice and text command. The system has been implemented successfully for 351 signs of Indian Sign Language under different possible video environments. The recognition rates are calculated for different video environments.

Authors and Affiliations

P Kishore

Keywords

Related Articles

Architecture of a Mediation System for Mobile Payment

Nowadays, the mobile phone has become an indispensable part of our daily. Exceeding the role of a communication apparatus, and benefitting from the evolution of technology, it could be used for several uses other than te...

Convex Hybrid Restoration and Segmentation Model for Color Images

Image restoration and segmentation are important areas in digital image processing and computer vision. In this paper, a new convex hybrid model is proposed for joint restoration and segmentation during the post-processi...

An integrated modular approach for Visual Analytic Systems in Electronic Health Records

Latest visual analytic tools help physicians to visualize temporal data in regards to medical health records. Existing systems lack vast support in the generalized collaboration, a single user-centered and task based des...

A New Algorithm for Post-Processing Covering Arrays

Software testing is a critical component of modern software development. For this reason, it has been one of the most active research topics for several years, resulting in many different algorithms, methodologies and to...

A DIY APPROACH TO UNI-TEMPORAL DATABASE IMPLEMENTATION

When historical versions of data are concerned for a MIS (Management Information System) we naturally might resort to temporal database products. These bi-temporal products, however, are often extravagant and not easily...

Download PDF file
  • EP ID EP150884
  • DOI -
  • Views 122
  • Downloads 0

How To Cite

P Kishore (2012). Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text. International Journal of Advanced Computer Science & Applications, 3(6), 35-47. https://europub.co.uk/articles/-A-150884