Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text

Abstract

This paper summarizes various algorithms used to design a sign language recognition system. Sign language is the language used by deaf people to communicate among themselves and with normal people. We designed a real time sign language recognition system that can recognize gestures of sign language from videos under complex backgrounds. Segmenting and tracking of non-rigid hands and head of the signer in sign language videos is achieved by using active contour models. Active contour energy minimization is done using signers hand and head skin colour, texture, boundary and shape information. Classification of signs is done by an artificial neural network using error back propagation algorithm. Each sign in the video is converted into a voice and text command. The system has been implemented successfully for 351 signs of Indian Sign Language under different possible video environments. The recognition rates are calculated for different video environments.

Authors and Affiliations

P Kishore

Keywords

Related Articles

Camera Calibration for 3D Leaf-Image Reconstruction using Singular Value Decomposition

Features of leaves can be more precisely captured using 3D imaging. A 3D leaf image is reconstructed using two 2D images taken using stereo cameras. Reconstructing 3D from 2D images is not straightforward. One of the imp...

A Novel Ball on Beam Stabilizing Platform with Inertial Sensors

This research paper presents dynamic modeling of inertial sensor based one degree of freedom (1-DoF) stabilizing platform. Plant is a ball on a pivoted beam. Nonlinear modeling of the plant is done. Ball position on beam...

An Accelerated Architecture Based on GPU and Multi-Processor Design for Fingerprint Recognition

Fingerprint recognition is widely used in security systems to recognize humans. In both industry and scientific literature, many fingerprint identification systems were developed using different techniques and approaches...

A Parallel Genetic Algorithm for Maximum Flow Problem

The maximum flow problem is a type of network optimization problem in the flow graph theory. Many important applications used the maximum flow problem and thus it has been studied by many researchers using different meth...

A Survey: Agent-based Software Technology Under the Eyes of Cyber Security, Security Controls, Attacks and Challenges

Recently, agent-based software technology has received wide attention by the research community due to its valuable benefits, such as reducing the load on networks and providing an efficient solution for the transmission...

Download PDF file
  • EP ID EP150884
  • DOI -
  • Views 76
  • Downloads 0

How To Cite

P Kishore (2012). Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text. International Journal of Advanced Computer Science & Applications, 3(6), 35-47. https://europub.co.uk/articles/-A-150884