Advanced methods for optimizing work with neural networks on modern architectures

Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 4

Abstract

The paper is devoted to the study and comparison of different optimization methods for training neural networks. Key algorithms such as stochastic gradient descent, Momentum method, AdaGrad and Adam are considered. For each method, theoretical justifications, mathematical formulas and examples of practical implementation are provided. An experimental comparison of the performance of these methods on the task of handwritten digit classification using the MNIST dataset is carried out. The advantages and disadvantages of each method are discussed, as well as their impact on the learning rate and accuracy of the model. Based on the results obtained, the most efficient algorithm is summarized, and the importance of selecting an appropriate optimization method to improve the efficiency of neural networks in various applications is emphasized.

Authors and Affiliations

P. M. Urvachev, V. A. Kovtun

Keywords

Related Articles

Model for assessing the investment attractiveness of regions

In this paper, a comprehensive model for evaluating the investment attractiveness of regions is presented. This model incorporates the influence of key indicators of investment attractiveness on investment risk, enabling...

On the calculation of a model of a three-dimensional turbulent diffusion plume

In this paper a three-dimensional model of diffusion combustion is presented in the case of the outflow of a combustible gas mixture from a rectangular nozzle and propagating in a heated (with a passing) air flow. For th...

Cutting tool stability and cutting speed

The article notes the importance of mechanical processing of parts produced for agricultural and engineering enterprises. It analyzes the use of modern cutting tools to give machine parts precise dimensions, a clean surf...

Principles of user interface design

In the world of Internet commercialization, the creation of unique software has been gaining popularity for several decades in a row. And in this process an important role is played by the creation of user interfaces, wh...

Using inventory systems

This article examines the problem of the non-universal use of various types of inventory systems within the boundaries of the Organization’s information infrastructure, and also emphasizes the fact of the effectiveness o...

Download PDF file
  • EP ID EP755369
  • DOI 10.47813/2782-2818-2024-4-4-0199-0212
  • Views 2
  • Downloads 0

How To Cite

P. M. Urvachev, V. A. Kovtun (2024). Advanced methods for optimizing work with neural networks on modern architectures. Modern Innovations, Systems and Technologies, 4(4), -. https://europub.co.uk/articles/-A-755369