NEURON MODEL SIGMOID ACTIVATION FUNCTION BASED ON MULTI-OPTIONAL FUNCTIONS ENTROPY CONDITIONAL OPTIMIZATION DOCTRINE
Journal Title: Електроніка та системи управління - Year 2018, Vol 4, Issue 58
Abstract
It is made an attempt to discover an explainable plausible reason for a neuron activation function, of a sigmoid type function like logistic function, substantiation in terms of the multi-optional conditional optimality doctrine for the special hybrid-optional effectiveness functions uncertainty. In the studied case, the input-output mapping is stipulated by the entropy of the activation function conditional optimal distribution in regards with the induced local field of the neuron. It is proposed to evaluate the direction of uncertainty with the combined hybrid relative pseudo-entropy function. This is a new insight into the scientific substantiation of the well-known dependency derived in another way. The developed theoretical contemplations and mathematical derivations are verified with numerical simulation and plotted diagrams.
Authors and Affiliations
Andriy Goncharenko
Keywords
Related Articles
- EP ID EP514740
- DOI 10.18372/1990-5548.58.13518
- Views 158
- Downloads 0
HIGH-PRECISION ONBOARD FUEL LEVEL CONTROL AND MEASUREMENT SYSTEM
The fueling systems of modern aircraft are considered. The need for their further improvement is shown in accordance with the recommendations of ICAO. A brief overview of methods and means of measuring fuel level in tank...
ADAPTIVE TESTING SYSTEM BASED ON THE FUZZY LOGIC
In this articl, the system analysis of the subject area of the evaluating the test results problem is performed, as a result of which it is classified into clear and fuzzy concepts and relations of the problem, which all...
MULTICRITERIA OPTIMIZATION PROBLEM STATEMENT IN ELECTRIC POWER INDUSTRY
In this paper, optimization problems of the electric power industry, modeled on the basis of nonstationary nonlinear systems, are considered. The analysis of admissible solutions of the optimization problem is performed...
MULTIFUNCTIONAL ROBOTIC COMPLEX BASED ON A SINGLE-BOARD COMPUTER
The necessity of organization and implementation of the aircraft elements deformations continuous control for the timely detection of their critical values is shown. A brief overview of existing methods and devices for m...
DIFFERENTIAL ANALYSIS OF 3D SENSOR IMAGES OF SURVEY-COMPARATIVE NAVIGATION SYSTEMS
Survey-comparative navigation systems are used for identification of landmarks that typically in the form of spatial objects the underlying surface. The most obvious method for obtains geometric features of the spatial o...