Advanced methods for optimizing work with neural networks on modern architectures
Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 4
Abstract
The paper is devoted to the study and comparison of different optimization methods for training neural networks. Key algorithms such as stochastic gradient descent, Momentum method, AdaGrad and Adam are considered. For each method, theoretical justifications, mathematical formulas and examples of practical implementation are provided. An experimental comparison of the performance of these methods on the task of handwritten digit classification using the MNIST dataset is carried out. The advantages and disadvantages of each method are discussed, as well as their impact on the learning rate and accuracy of the model. Based on the results obtained, the most efficient algorithm is summarized, and the importance of selecting an appropriate optimization method to improve the efficiency of neural networks in various applications is emphasized.
Authors and Affiliations
P. M. Urvachev, V. A. Kovtun
Model for assessing the investment attractiveness of regions
In this paper, a comprehensive model for evaluating the investment attractiveness of regions is presented. This model incorporates the influence of key indicators of investment attractiveness on investment risk, enabling...
On the calculation of a model of a three-dimensional turbulent diffusion plume
In this paper a three-dimensional model of diffusion combustion is presented in the case of the outflow of a combustible gas mixture from a rectangular nozzle and propagating in a heated (with a passing) air flow. For th...
Cutting tool stability and cutting speed
The article notes the importance of mechanical processing of parts produced for agricultural and engineering enterprises. It analyzes the use of modern cutting tools to give machine parts precise dimensions, a clean surf...
Principles of user interface design
In the world of Internet commercialization, the creation of unique software has been gaining popularity for several decades in a row. And in this process an important role is played by the creation of user interfaces, wh...
Using inventory systems
This article examines the problem of the non-universal use of various types of inventory systems within the boundaries of the Organization’s information infrastructure, and also emphasizes the fact of the effectiveness o...