Enhancing Sign Language Understanding through Machine Learning at the Sentence Level
Journal Title: International Journal of Experimental Research and Review - Year 2024, Vol 41, Issue 5
Abstract
The visual language of sign language is based on nonverbal communication, including hand and body gestures. When it comes to communicating, it is the main tool for those who are deaf or hard of hearing all around the globe. Useful for both hearing and deaf persons, this can translate sign language into sentences in real-time or help those who are hard of hearing communicate with others. This work focuses on developing a sentence-level sign language detection system utilizing a custom dataset and Random Forest model. Leveraging tools such as Media Pipe and TensorFlow, we facilitate gesture detection. Through continuous detection of gestures, we generate a list of corresponding labels. These labels are then used to construct sentences automatically. The system seamlessly integrates with ChatGPT, allowing direct access to generate sentences based on the detected gestures. Our custom dataset ensures that the model can accurately interpret a wide range of sign language gestures. Our method helps close the communication gap between people who use sign language and others, with an accuracy of 80%, by merging machine learning with complex language models.
Authors and Affiliations
Ch Sekhar, Juthuka Aruna Devi, Mirtipati Satish Kumar, Kinthali Swathi, Pala Pooja Ratnam, Marada Srinivasa Rao
Keywords
Related Articles
- EP ID EP741625
- DOI 10.52756/ijerr.2024.v41spl.002
- Views 47
- Downloads 0
The importance of financial liquidity analysis in an enterprise
The article attempts to present the importance of financial liquidity analysis and its impact on financial condition of an enterprise. It introduces financial analysis tools and effects of losing of financial liquidity i...
A Geo-Spatial analysis and assessment of groundwater potential zones by using remote sensing and GIS techniques-A micro level study of Bhagwanpur-I CD Block in Purba Medinipur District, West Bengal, India
The important resource of groundwater is a contributing significantly in total annual supply. However, over exploitation has depleted groundwater availability considerably and also led to land subsidence at some places....
The concept and essence of human capital
The article attempts to present the concept and essence of human capital. This subject is still current and evolves, along with dynamic changes in the market. Each company should determinate the need of its employees and...
Zooplankton Bio-indicators Against Changing Hydrological Parameters at Bidyadhari River of Indian Sundarbans
Sundarban Estuarine System is influenced by periodic tidal input and fresh water inflow. It is surrounded by world’s largest mangrove ecosystem and harbour naturally grown fishery. The total system is intersected by a ne...
Agrometeorological indices, physiological growth parameters and performance of finger millet as influenced by different cultivars under hot and sub humid region of Odisha
Present-day agriculture is under tremendous pressure due to various factors such as climate change, degradation of soil and water quality, and yield plateauing of major food crops. Under these scenarios, there is an urge...