Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text

Abstract

This paper summarizes various algorithms used to design a sign language recognition system. Sign language is the language used by deaf people to communicate among themselves and with normal people. We designed a real time sign language recognition system that can recognize gestures of sign language from videos under complex backgrounds. Segmenting and tracking of non-rigid hands and head of the signer in sign language videos is achieved by using active contour models. Active contour energy minimization is done using signers hand and head skin colour, texture, boundary and shape information. Classification of signs is done by an artificial neural network using error back propagation algorithm. Each sign in the video is converted into a voice and text command. The system has been implemented successfully for 351 signs of Indian Sign Language under different possible video environments. The recognition rates are calculated for different video environments.

Authors and Affiliations

P Kishore

Keywords

Related Articles

Feature Descriptor Based on Normalized Corners and Moment Invariant for Panoramic Scene Generation

Panorama generation systems aim at creating a wide-view image by aligning and stitching a sequence of images. The technology is extensively used in many fields such as virtual reality, medical image analysis, and geologi...

Cyberspace Forensics Readiness and Security Awareness Mode

The goal of reaching a high level of security in wire- less and wired communication networks is continuously proving difficult to achieve. The speed at which both keepers and violators of secure networks are evolving is...

A Review of Towered Big-Data Service Model for Biomedical Text-Mining Databases

The rapid growth of biomedical informatics has drawn increasing popularity and attention. The reason behind this are the advances in genomic, new molecular, biomedical approaches and various applications like protein ide...

Analyzing the Social Awareness in Autistic Children Trained through Multimedia Intervention Tool using Data Mining

This study focuses on creating a guideline for the ASD children by simulating the situation and analyzing the understanding of ASD (Asperger Syndrome) children over social skills by using a multimedia intervention tool d...

Review of Cross-Platforms for Mobile Learning Application Development

Mobile learning management systems are very important for training purpose. But considering the present scenario, the learners are equipped with a number of mobile devices that run by different operating systems with div...

Download PDF file
  • EP ID EP150884
  • DOI -
  • Views 107
  • Downloads 0

How To Cite

P Kishore (2012). Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text. International Journal of Advanced Computer Science & Applications, 3(6), 35-47. https://europub.co.uk/articles/-A-150884