GESTURE RECOGNITION OF MACHINE LEARNING AND CONVOLUTIONAL NEURAL NETWORK METHODS FOR KAZAKH SIGN LANGUAGE
Journal Title: Scientific Journal of Astana IT University - Year 2023, Vol 15, Issue 15
Abstract
Recently, there has been a growing interest in machine learning and neural networks among the public, largely due to advancements in technology which have led to improved methods of computer recognition of objects, sounds, texts, and other data types. As a result, human-computer interactions are becoming more natural and comprehensible to the average person. The progress in computer vision has enabled the use of increasingly sophisticated models for object recognition in images and videos, which can also be applied to recognize hand gestures. In this research, popular hand gesture recognition models, such as the Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and Support Vector Machine (SVM) were examined. These models vary in their approaches, processing time, and training data size. The important feature of this research work is the use of various machine learning algorithms and methods such as CNN, LSTM, and SVM. Experiments showed different results when training neural networks for sign language recognition in the Kazakh sign language based on the dactyl alphabet. This article provides a detailed description of each method, their respective purposes, and effectiveness in terms of performance and training. Numerous experimental results were recorded in a table, demonstrating the accuracy of recognizing each gesture. Additionally, specific hand gestures were isolated for testing in front of the camera to recognize the gesture and display the result on the screen. An important feature was the use of mathematical formulas and functions to explain the working principle of the machine learning algorithm, as well as the logical scheme and structure of the LSTM algorithm.
Authors and Affiliations
Samat Mukhanov, Raissa Uskenbayeva , Young Im Cho, Dauren Kabyl, Nurzhan Les, Maqsat Amangeldi
Keywords
Related Articles
- EP ID EP723061
- DOI -
- Views 73
- Downloads 0
TRACKING OF NON-STANDARD TRAJECTORIES USING MPC METHODS WITH CONSTRAINTS HANDLING ALGORITHM
In recent decades, a Model-Based Predictive Control (MPC) has revealed its dominance over other control methods such as having an ability of constraints handling and input optimization in terms of the value function. H...
IMPROVING THE METHOD OF SEARCHING DIGITAL ILLEGAL MEANS OBTAINING INFORMATION BASED ON CLUSTER ANALYSIS
Іn the article the possibilities of the multipositional technology of searching digital insertion devices are investigated based on clustering. Existing means of detecting radiation of digital illegal means obtaining inf...
METHODS OF PROJECT-VECTOR MANAGEMENT OF EDUCATIONAL ENVIRONMENTS
Based on the developed mathematical model of the project-vector space, the methods of determining the endpoints of the objects of the project-vector space (PVS) and the calculation of the trajectory of the movement to...
AN ANALYSIS OF THE HETEROGENEOUS IOT DEVICE NETWORK INTERACTION IN A CYBER-PHYSICAL SYSTEM
The article is devoted to the study of existing technologies regarding Internet of Things (IoT) device interaction in a heterogeneous network. Since each smart home appliance can be controlled by a customer who aims to f...
APPLICATION OF INFORMATION TECHNOLOGIES FOR SEMANTIC TEXT PROCESSING
An expert system for text analysis based on the heuristic knowledge of an expert linguist is proposed. Methods of linguistic analysis of the text through the use of computer technology have been further developed. Data...