Detection and Interpretation of Indian Sign Language Using LSTM Networks
Journal Title: Journal of Intelligent Systems and Control - Year 2023, Vol 2, Issue 3
Abstract
Sign language plays a crucial role in communication for individuals with speech or hearing difficulties. However, the lack of a comprehensive Indian Sign Language (ISL) corpus impedes the development of text-to-ISL conversion systems. This study proposes a specific deep learning-based sign language detection system tailored specifically for Indian Sign Language (ISL). The proposed system utilizes Long Short-Term Memory (LSTM) networks to detect and recognize actions from dynamic ISL gestures captured in videos. Initially, the system employs computer vision algorithms to extract relevant features and representations from the input gestures. Subsequently, an LSTM-based deep learning architecture is employed to capture the temporal dependencies and patterns within the gestures. LSTM models excel in sequential data processing, making them well-suited for analyzing the dynamic nature of sign language gestures. To assess the effectiveness of the proposed system, extensive experimentation and evaluation were conducted. A customized dataset was curated, encompassing a diverse range of ISL sign language actions. This dataset was created by collecting video recordings of native ISL users performing various actions, ensuring comprehensive coverage of gestures and expressions. These videos were meticulously annotated and labelled with corresponding textual representations of the gestures. The dataset was then split into training and testing sets to train the LSTM-based model and evaluate its performance. The proposed system yielded promising results during the validation process, achieving a training accuracy of 96% and a test accuracy of 87% for ISL recognition. These results outperformed previous approaches in the field. The system's ability to effectively detect and recognize actions from dynamic ISL gestures, facilitated by the deep learning-based approach utilizing LSTM networks, demonstrates the potential for more accurate and robust sign language recognition systems. However, it is important to acknowledge the limitations of the system. Currently, the system's primary focus is on recognizing individual words rather than full sentences, indicating the need for further research to enhance sentence-level interpretations. Additionally, variations in lighting conditions, camera angles, and hand orientations can potentially impact the system's accuracy, particularly in the context of ISL.
Authors and Affiliations
Piyusha Vyavahare, Sanket Dhawale, Priyanka Takale, Vikrant Koli, Bhavana Kanawade, ,Shraddha Khonde
Keywords
Related Articles
- EP ID EP732127
- DOI https://doi.org/10.56578/jisc020302
- Views 89
- Downloads 0
New 5D Hyperchaotic System Derived from the Sprott C System: Properties and Anti Synchronization
This study introduces a new ten-term 5-D hyperchaotic system, derived from the 3-D Sprott C system. The proposed system has coexisting two attractors: the self-excited and hidden attractors. This system exhibits a rich a...
Comparative Analysis of PID and Fuzzy Logic Controllers for Position Control in Double-Link Robotic Manipulators
This study presents a comprehensive evaluation of linear and non-linear control systems, specifically Proportion Integration Differentiation (PID) and fuzzy logic controllers, in the context of position control within do...
Optimization of Lateral Transfer Inventory of Auto Spare Parts Based on Neural Network Forecasting
Creating a fair replenishment strategy is one of the most significant instruments in the inventory management for automotive spare parts. It is also crucial to controlling the enterprise's inventory level. This study con...
Hybrid Approach Control of Micro-Positioning Stage with a Piezoelectric Actuator
For a class of system with nonlinear hysteresis, this paper presents an adaptive hybrid controller based on the hybrid backstepping-sliding mode, and describes the controller analytically by the LuGre model. Both backste...
An Efficient Reconfigurable Cryptographic Model for Dynamic and Secure Unstructured Data Sharing in Multi-Cloud Storage Server
This study designs a reconfigurable multi-cloud storage server architecture for dynamic and secure data sharing has been designed, improves the security of unstructured data using cryptographic index-based data slicing (...