NEURON MODEL SIGMOID ACTIVATION FUNCTION BASED ON MULTI-OPTIONAL FUNCTIONS ENTROPY CONDITIONAL OPTIMIZATION DOCTRINE
Journal Title: Електроніка та системи управління - Year 2018, Vol 4, Issue 58
Abstract
It is made an attempt to discover an explainable plausible reason for a neuron activation function, of a sigmoid type function like logistic function, substantiation in terms of the multi-optional conditional optimality doctrine for the special hybrid-optional effectiveness functions uncertainty. In the studied case, the input-output mapping is stipulated by the entropy of the activation function conditional optimal distribution in regards with the induced local field of the neuron. It is proposed to evaluate the direction of uncertainty with the combined hybrid relative pseudo-entropy function. This is a new insight into the scientific substantiation of the well-known dependency derived in another way. The developed theoretical contemplations and mathematical derivations are verified with numerical simulation and plotted diagrams.
Authors and Affiliations
Andriy Goncharenko
Keywords
Related Articles
- EP ID EP514740
- DOI 10.18372/1990-5548.58.13518
- Views 156
- Downloads 0
COMPENSATION OF QUADRATURED ERROR IN THE AUTO-OSCILLATION MICROMECHANICAL GYROSCOPE
In this paper, attention was paid to the analysis of the micromechanical sensor unit of the inertial navigation system as the main component of an unmanned aerial vehicle, as well as to improve the technical characterist...
MULTIFUNCTIONAL RADIO MONITORING ANTENNA
The theoretical bases of the development of an antennas for monitoring system are presented. Antennas combine the functions of measuring the emissions parameters, directional finding and suppression of the interference w...
SOME ASPECTS OF ACOUSTIC EMISSION AT MACHINING COMPOSITE MATERIALS
The processing of outcomes acoustic emission signals simulation is conducted at ascending composite machining speed and cutting depth, change of treated composite physical-mechanical characteristics with definition the r...
NEURAL NETWORKS MODULE
It is considered a basic approach for hybrid neuron network creation. As an example, the counter propagation neural network is analyzed. It is effectively used for image processing. Two modes of this neuron network funct...
FEATURES OF MULTIPLICATIVE COMPLEMENTARY SIGNAL CONSTRUCTIONS BASED ON GENERALIZED BINARY BARKER SEQUENCES
Radio and signal processing systems often use spread-spectrum and pulse compression techniques combined with the matched filtering approach as the main signal processing scheme. Among different signals that have been des...