NEURON MODEL SIGMOID ACTIVATION FUNCTION BASED ON MULTI-OPTIONAL FUNCTIONS ENTROPY CONDITIONAL OPTIMIZATION DOCTRINE
Journal Title: Електроніка та системи управління - Year 2018, Vol 4, Issue 58
Abstract
It is made an attempt to discover an explainable plausible reason for a neuron activation function, of a sigmoid type function like logistic function, substantiation in terms of the multi-optional conditional optimality doctrine for the special hybrid-optional effectiveness functions uncertainty. In the studied case, the input-output mapping is stipulated by the entropy of the activation function conditional optimal distribution in regards with the induced local field of the neuron. It is proposed to evaluate the direction of uncertainty with the combined hybrid relative pseudo-entropy function. This is a new insight into the scientific substantiation of the well-known dependency derived in another way. The developed theoretical contemplations and mathematical derivations are verified with numerical simulation and plotted diagrams.
Authors and Affiliations
Andriy Goncharenko
Keywords
Related Articles
- EP ID EP514740
- DOI 10.18372/1990-5548.58.13518
- Views 133
- Downloads 0
ADJUSTABLE LOAD FOR AUTOMATIC TESTING OF DC POWER SUPPLY
This article is devoted to the development of adjustable electronic load for direct current power supply testing systems. The structure of the electronic loadunit, which allows to regulate the currents of the tested sour...
METHOD OF DETERMINING THE ACCURACY CHARACTERISTICS OF THE SATELLITE NAVIGATION SYSTEM
The key actions for the implementation of the global navigation satellite systems are described in this article. At the testing stage, the conformity of the system with the operating standards is established, its accurac...
DIAGNOSTIC SYSTEM BASED ON AUTOENCODERS
It`s considered the problem of image processing which is used in diagnostic systems when it is necessary to process the results of ultrasound, computed tomography and magnetic resonance imaging. For the solution of this...
ACCURACY ESTIMATION OF FLIGHT TEST RESULTS ON THE BASIS OF APPROXIMATING THE CORRELATION FUNCTION
The solution of the problem is considered, as a result of which estimates of statistical characteristics after processing the results of flight tests by the double averaging method, both in time and in the ensemble of re...
NEURON MODEL SIGMOID ACTIVATION FUNCTION BASED ON MULTI-OPTIONAL FUNCTIONS ENTROPY CONDITIONAL OPTIMIZATION DOCTRINE
It is made an attempt to discover an explainable plausible reason for a neuron activation function, of a sigmoid type function like logistic function, substantiation in terms of the multi-optional conditional optimality...